Have you tried the latest SVN? Ash has done a lot of work with speed and load issues. He was able to get the database calls down from 170+ to 40-60.
Here is a demo of the latest build:
www.clubkb.com/pligg Maybe it's just me or the hosting but it's not slow at all.