It's very difficult to classify bad/good bots, some bots just crawl your site to steal your content or emai ID or some for helping you for indexing your content for SE's.
You have to study your log file for deciding who are helpful bots and accordingly should are allowed.
Not all bots obey robots.txt file
