This is a simple one: Minimize a Finder window into the dock, control- (or right-) click on the minimized window, and select "Close." Unfortunately, this only works for Finder windows ... but maybe Apple will implement it in their other applications, too.
Mac OS X Hints
http://hints.macworld.com/article.php?story=20031025155515908