Thread: Google Bots
View Single Post
  #2 (permalink)  
Old Jun 29th, 2007, 18:35
spinal007's Avatar
spinal007 spinal007 is offline
Moderator
Join Date: Mar 2004
Location: Good Ol'London
Age: 23
Posts: 1,650
Blog Entries: 1
Thanks: 0
Thanked 4 Times in 4 Posts
Re: Google Bots

Erm... Google crawls the web. If your site is not on the web (on something like http://www.yoursite.com/) then it won't be indexed.

Otherwise, Google will index it if and when...
a) it finds a link to your site somewhere on the web
or
b) if you ask Google to.

But you website's indexing still depends on your robots.txt file, in which you can ask spiders not to index certain pages/sections of your site.

That's as complete an answer as I can give...
Reply With Quote