Feb 14th, 2008, 18:12
|
|
SuperMember
|
|
Join Date: Dec 2007
Location: London
Age: 35
Posts: 268
Thanks: 2
Thanked 0 Times in 0 Posts
|
|
|
Re: Adivse on robots.txt
hmm
the code bellow was taken from http://www.robotstxt.org/robotstxt.html
- HTML: Select all
[b]To allow a single robot[/b]
User-agent: Google
Disallow:
User-agent: *
Disallow: /
|