Web Design and Development Forums

Robots.txt

This is a discussion on "Robots.txt" within the Search Engines section. This forum, and the thread "Robots.txt are both part of the Search Engines and SEO category.

Old Dec 15th, 2007, 07:45   #1 (permalink)
Blog Moderator

 
simonb's Avatar
 
Join Date: Dec 2006
Location: Norwich
Posts: 601
Blog Entries: 3
Send a message via Skype™ to simonb
Robots.txt
I want to add a robot.txt to my smf forum, I don't know how to write complece ones

i want to block
/index.php?action=search
/index.php?action=admin
/index.php?action=mlist
/index.php?action=login
/index.php?action=reminder
/index.php?action=register
/index.php?action=help
/Theme/every foulder in there

can so one do that or teach me
__________________
Simple Simon | The Net is Dying | We Are Battlefield Heroes Forum
simonb is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Old Dec 15th, 2007, 07:47   #2 (permalink)
Blog Moderator

 
simonb's Avatar
 
Join Date: Dec 2006
Location: Norwich
Posts: 601
Blog Entries: 3
Send a message via Skype™ to simonb
Re: Robot.txt
also
/index.php?action=stats
/index.php?action=who
__________________
Simple Simon | The Net is Dying | We Are Battlefield Heroes Forum
simonb is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Old Dec 15th, 2007, 08:38   #3 (permalink)
Lead Administrator
 
saltedm8's Avatar
 
Join Date: Nov 2005
Location: Always About
Age: 27
Posts: 1,062
Blog Entries: 1
Send a message via MSN to saltedm8
Re: Robot.txt
User-agent: *
Disallow: /index.php?action=search
Disallow: /index.php?action=admin
Disallow: /index.php?action=mlist
Disallow: /index.php?action=login
Disallow: /index.php?action=reminder
Disallow: /index.php?action=register
Disallow: /index.php?action=help
Disallow: /Theme
Disallow: /index.php?action=stats
Disallow: /index.php?action=who

look here
http://www.google.com/support/webmas...362&topic=8846
__________________
recipebite.co.uk - its a working progress...
Last edited by saltedm8; Dec 15th, 2007 at 08:41.
saltedm8 is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Old Dec 15th, 2007, 09:17   #4 (permalink)
Blog Moderator

 
simonb's Avatar
 
Join Date: Dec 2006
Location: Norwich
Posts: 601
Blog Entries: 3
Send a message via Skype™ to simonb
Re: Robot.txt
thanks give it a shot.
__________________
Simple Simon | The Net is Dying | We Are Battlefield Heroes Forum
simonb is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Old Dec 16th, 2007, 11:36   #5 (permalink)
Administrator
 
alexgeek's Avatar
 
Join Date: Jul 2007
Location: Webforumz 24/7
Age: 15
Posts: 4,102
Blog Entries: 9
Send a message via MSN to alexgeek
Re: Robot.txt
It's robots.txt by the way
__________________
Languages: PHP, mySQL (queries), C#, (X)html, CSS, JS.
alexgeek is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Old Dec 16th, 2007, 11:50   #6 (permalink)
Blog Moderator

 
simonb's Avatar
 
Join Date: Dec 2006
Location: Norwich
Posts: 601
Blog Entries: 3
Send a message via Skype™ to simonb
Re: Robot.txt
i found that out when google gave me a 404 lol.
__________________
Simple Simon | The Net is Dying | We Are Battlefield Heroes Forum
simonb is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Old Dec 16th, 2007, 17:56   #7 (permalink)
Administrator
 
alexgeek's Avatar
 
Join Date: Jul 2007
Location: Webforumz 24/7
Age: 15
Posts: 4,102
Blog Entries: 9
Send a message via MSN to alexgeek
Re: Robot.txt
Oh dear! Someone change the title to robots.txt.
__________________
Languages: PHP, mySQL (queries), C#, (X)html, CSS, JS.
alexgeek is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Old Feb 21st, 2008, 06:02   #8 (permalink)
Junior Member
 
Join Date: Feb 2008
Location: USA
Age: 27
Posts: 25
Exclamation Re: Robots.txt
hi simonb, i couldn't understand your question. you want to add robot.txt with your forum but it is added with your website. how will you do this?
Mitchelle Johnson is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Old Mar 24th, 2008, 11:07   #9 (permalink)
Junior Member
 
Join Date: Mar 2008
Location: UK
Posts: 41
Send a message via Skype™ to pctank
Re: Robots.txt
This forum is very helpful!
Im spending my whole day on this forum before i search yahoo or google for help!!

Keep it up!
pctank is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Old Mar 28th, 2008, 11:43   #10 (permalink)
Junior Member
 
Join Date: Feb 2007
Location: USA
Age: 25
Posts: 35
Re: Robots.txt
Guys where is the tool for robots.txt creation? Or rules or?
Therefore is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Reply

« [SOLVED] Google Page Rank: 0 | Different PR on different datacentres »
Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
robots.txt alexgeek Search Engine Optimization (SEO) 2 Oct 22nd, 2007 22:11
robots alexgeek Search Engine Optimization (SEO) 8 Sep 28th, 2007 15:43
Security vs robots cbisson Website Planning Discussion 11 Jun 28th, 2007 12:51



Latest Updates

All Points SEO Security Advisory - CHECK YOUR SITE NOW!

Creative Coding :: February 2008
Webforumz is sponsored by: WESH UK Web Hosting
All times are GMT. The time now is 21:49.

Sleep Study Scoring :: Free Bet :: Website Templates :: Online Betting :: Bookmakers :: Funny Quotes :: Internet Recruitment Software :: Microsoft CRM Experts :: Online Casino :: Decorated Christmas Trees :: Midwife Forums :: Football Betting :: Ecommerce Software :: Web Hosting :: Football Stats :: Dry Cleaning Collection :: xtreme wales - extreme clothing :: Apuestas :: Sharepoint Consultants :: Website Optimisation :: Office Clearance London :: Sharepoint Experts :: Sports Betting :: Casino :: Website Templates :: Web Design Development India :: Online Gambling

Powered by: vBulletin Version 3.7, Copyright ©2000 - 2008, Jelsoft Enterprises Limited.
© 2003-2008 Webforumz.com : All Rights Reserved
Search Engine Friendly URLs by vBSEO 3.2.0 RC6


1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59