I've been missing connections with other iChat audio users. Sometimes I'll see a message that reads "There have been no packets sent for 10 seconds." I'm not sure what this means, exactly, but quitting and restarting iChat solves the problems.
Mac OS X Hints
http://hints.macworld.com/article.php?story=20030624180228488