This is a discussion on "robots.txt" within the Search Engine Optimization (SEO) section. This forum, and the thread "robots.txt are both part of the Promote Your Website category.
|
|
|
|
|
 |
||
robots.txt
|
||
| Notices |
 |
|
|
LinkBack | Thread Tools |
|
#1
Oct 22nd, 2007, 19:36
|
||||
|
||||
robots.txt
If I blog a page called "blog.php" in robots.txt will it also block "blog.php?id=3" etc.?
Or do I need to put some special character to make sure it blocks all of them? Hope that makes sense!
Last Blog Entry: 3D Chess in your browser! (Mar 14th, 2008)
       
|
|
|
|
#2
Oct 22nd, 2007, 21:59
|
|||
|
|||
|
Re: robots.txt
I would presume it blocks blog.php becuase it's the same page but just displaying different content
|
|
#3
Oct 22nd, 2007, 22:11
|
||||
|
||||
|
Re: robots.txt
I just thought since google will index "blog.php?id=1" and "blog.php?id=2" as two different pages, I may need to put some special character.
Last Blog Entry: 3D Chess in your browser! (Mar 14th, 2008)
|
|
| Thread Tools | |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Robots.txt | simonb | Search Engine Optimization (SEO) | 9 | Mar 28th, 2008 11:43 |
| robots | alexgeek | Search Engine Optimization (SEO) | 8 | Sep 28th, 2007 15:43 |
| Security vs robots | cbisson | Website Planning | 11 | Jun 28th, 2007 12:51 |
| How to Stop Robots | Gee Bee | Web Page Design | 4 | Jan 26th, 2006 18:56 |
