This is a discussion on "robots" within the Search Engine Optimization (SEO) section. This forum, and the thread "robots are both part of the Promote Your Website category.
|
|
|
|
|
 |
||
robots
|
||
| Notices |
 |
|
|
LinkBack | Thread Tools |
Sep 24th, 2007, 17:41
|
||||
|
||||
|
robots
For rel="nofollow" to work,
does there need to be something in a robots.txt? if so please say what thanks
Last Blog Entry: 3D Chess in your browser! (Mar 14th, 2008)
|
|
|
|
Sep 24th, 2007, 20:47
|
||||
|
||||
|
Re: robots
Nope although robots.txt is an easier way to do it if you have alot of files... I am sure but don't quote me on that
|
|
Sep 24th, 2007, 20:52
|
||||
|
||||
|
Re: robots
I'd prefer the robots.txt method then.
or both.
Last Blog Entry: 3D Chess in your browser! (Mar 14th, 2008)
|
|
Sep 24th, 2007, 21:11
|
||||
|
||||
|
Re: robots
Have a look here for more info: http://www.robotstxt.org/wc/exclusion.html.
|
|
Sep 27th, 2007, 22:08
|
||||
|
||||
|
Re: robots
Keep in mind that there is no guarantee that rel=nofollow OR robots.txt rules are followed by every robot. If you are trying to really hide something from SEs, password protect it.
If that's not the case, I'd use both methods to make sure.
Last Blog Entry: Random String in Javascript (Apr 21st, 2008)
|
|
Sep 27th, 2007, 22:34
|
||||
|
||||
|
Re: robots
yeah wanted to do the same thing as WF does with the sigs
Last Blog Entry: 3D Chess in your browser! (Mar 14th, 2008)
|
|
Sep 28th, 2007, 09:53
|
|||
|
|||
|
Re: robots
For preventing bots for crawling links of signatures "nofollow tag" would be the good option rather then using robots'txt which will avoid crawling the whole page.
|
|
Sep 28th, 2007, 10:00
|
||||
|
||||
|
Re: robots
Like Andy said, robots.txt is not the answer for you. It's intended to stop SEs indexing a certain page, it's not for telling SEs not to follow a certain link. There's a key difference...
Last Blog Entry: Random String in Javascript (Apr 21st, 2008)
|
|
Sep 28th, 2007, 15:43
|
||||
|
||||
|
Re: robots
Thanks guys
Last Blog Entry: 3D Chess in your browser! (Mar 14th, 2008)
|
|
| Thread Tools | |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Robots.txt | simonb | Search Engine Optimization (SEO) | 9 | Mar 28th, 2008 11:43 |
| robots.txt | alexgeek | Search Engine Optimization (SEO) | 2 | Oct 22nd, 2007 22:11 |
| Security vs robots | cbisson | Website Planning | 11 | Jun 28th, 2007 12:51 |
| How to Stop Robots | Gee Bee | Web Page Design | 4 | Jan 26th, 2006 18:56 |
