View Single Post
  #6 (permalink)  
Old May 18th, 2007, 10:03
JacobHaug's Avatar
JacobHaug JacobHaug is offline
SuperMember

SuperMember
Join Date: Dec 2005
Location: On Internet
Posts: 4,859
Thanks: 0
Thanked 0 Times in 0 Posts
Send a message via AIM to JacobHaug Send a message via MSN to JacobHaug
Re: Bandwidth being munched - help !!!

Hahaha...this has got to be the funniest post on earth or maybe I just need to get some sleep.

Try applying it on the page itself.

Code: Select all
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW, NOARCHIVE" />
Ummm, my caps were on. You might want to lower case it.

Now on to the part that I thought was funny. You said in your robots.txt file you stopped robots from going into your public_html directory. So the robot is not going to go in to this.

http://www.yourdomain.com/public_html/

The public_html directory is just a folder used to store the files for your domain. That is where the stuff is accessed though the browser. So change it to reflect the pages you don't want the robot to access. The meta tag above will do the trick!

I hoped this made since, if not let me know and I will repost when I get some sleep!
Reply With Quote