I thought I had solved my comment spam issues but alas it was not so. The spammers got smarter so now I've brought in the big guns. The new WP HashCash plugin uses client side md5 hashes to ensure that a human is making the post. Since I've installed it I've had no spam. If I get popular enough that spammers manually spam me I'll worry about that then :-)