The control to manage the spam is not really that great. After manually dealing with them for the longest time (IE, through b2evo), I decided to go directly into the database and delete the comments myself. This is much easier way to deal with spam. After all, how do you deal with spams when there are 50K + spam?
Here is an example of what I might do:
DELETE FROM `evo_comments` WHERE comment_status = 'draft' and comment_author_email like '%aneaprod%'
I know it's not the way to go, but if there is a way to selectively filter and remove spam, of course, I would use the proper way. But, above works quite well.