Thread: Adivse on robots.txt
View Single Post
  #2 (permalink)  
Old Feb 14th, 2008, 08:44
unitedcraig's Avatar
unitedcraig unitedcraig is offline
SuperMember

SuperMember
Join Date: Oct 2007
Location: Stockport
Age: 17
Posts: 825
Blog Entries: 1
Thanks: 0
Thanked 0 Times in 0 Posts
Re: Adivse on robots.txt
i think this will help you

http://www.robotstxt.org/

craig
__________________
Reply With Quote