Apparently all this time I have been in training mode! I never realized that I had to turn junk mail filtering on! The menu option to do this is under Mail -> Junk Mail -> Automatic.
I'm sure this was very obvious to some, and they found this feature early, but if I'm guessing that there may be others like me that don't have it turned on.

