I have a smart playlist called To Be Rated (auto updating for all songs rated less than 1 star). I used to listen to this at work and rate songs as I went (using the excellent iTunes Rating app). However, if I was really enjoying something and I gave it a 4 or 5, it would suddenly stop playing and disappear as it was ejected from the smart playlist once it was rated. Furthermore, if I really was absorbed in the track, I might forget to rate it and then had to laboriously go back and find it.
Solution! Make the Party Shuffle playlist work off the To Be Rated smart playlist. Now even if I rate songs while they are playing, they will not stop as they are part of the Party Shuffle -- but they *will* fall out of the To Be Rated playlist. And what's more, I can rate the songs after they have been played by setting Party Shuffle to show the last 10 songs played. Simple yet effective.