Okay I need this odd project helped out.
I need a spyder that will crawl pages and gather keywords, descriptions, and
SCREEN SHOTS OF THE HOME PAGE. Now if i was just doing keywords and descriptions I'd wright a spider right now, but my problem is the Screen Shots. My website: egtworlds.com needs to have the ability to crawl submitted sights and open the first page it gets and take a snapshot of it for my active directory.
OUCH! I have no idea how to do that. So i was wondering if you new of any software like a command line, or any web services out there (including
php source for one) that are free, open sourced, or reasonable priced.
Thanks for the help, I'll also take ideas if you know how to do this in
php or know of a good way to do this. I'll also need to have the ability to compress it into a thumbnail either on runtime or as the spyder crawls the site.