Bandwidth being munched - help !!!

mjwraw · May 17th, 2007, 14:17

Firstly please excuse my lengthy post, but please bear with me......

Up until recently my website has never been heavily used, which is fine for me - my hosting plan allows for 2.5 Gb bandwidth limit per month, which was fine as I used to average about 500 mb per month. However, since April 4th 2007 this has massively jumped, to the point where (like now) my limit is exceeded before I'm halfway through the month.

I have one page, (not my homepage though), which links to a large number of jpegs, (1100 images averaging 85k in size), but this has been true for over a year, and up until recently I hadn't had any bandwidth issues.

I have now added a .htaccess file, (to stop any hot-linking), and robots.txt file, (to stop crawlers), to my public_html directory, but this doesn't seem to have made any difference. Looking at my access logs it still appears to be crawlers crawling the page which links to the images which is really hammering my bandwidth, but I don't understand either why it's just started happening, (although I haven't really changed my site design), or why I seem powerless to stop it ???

Can anyone help me please

Phixon · May 17th, 2007, 14:23

How much are you paying for your current hosting, if you dontmind me asking?

mjwraw · May 17th, 2007, 14:33

I think its about £25 per year

Phixon · May 17th, 2007, 14:36

could you send me alink to your site. you can do it via PM if you wish to continue to keep traffic down :P

mjwraw · May 17th, 2007, 14:49

OK, its www.mypunkcollection.co.uk, but you'll get a Bandwidth Exceeded error

JacobHaug · May 18th, 2007, 10:03

Hahaha...this has got to be the funniest post on earth or maybe I just need to get some sleep.

Try applying it on the page itself.

Code: Select all

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW, NOARCHIVE" />

Ummm, my caps were on. You might want to lower case it.

Now on to the part that I thought was funny. You said in your robots.txt file you stopped robots from going into your public_html directory. So the robot is not going to go in to this.

http://www.yourdomain.com/public_html/

The public_html directory is just a folder used to store the files for your domain. That is where the stuff is accessed though the browser. So change it to reflect the pages you don't want the robot to access. The meta tag above will do the trick!

I hoped this made since, if not let me know and I will repost when I get some sleep!

Ryan Fait · May 19th, 2007, 02:19

2.5 gb a month isn't very much. Site5 has some awesome plans. Move from 2.5 gb to 5 tb bandwidth per month.

JacobHaug · May 19th, 2007, 20:02

Yep, or if you prefer a monthly fee, try out godaddy.com.

jjgamepro17 · May 23rd, 2007, 16:11

I get 250gb of bandwith with Godaddy and 50gb of webspace... But im about to switch to site5 though.