View Single Post
  #2 (permalink)  
Old Jan 31st, 2008, 09:17
saltedm8's Avatar
saltedm8 saltedm8 is online now
Lead Administrator
Join Date: Nov 2005
Location: Always About
Age: 27
Posts: 1,435
Blog Entries: 1
Thanks: 1
Thanked 6 Times in 6 Posts
Re: Getting Google to ignore pages not in sitemap?

you can use robots.txt to disallow indexing of certain pages, here is an example of how it is done

# robots.txt
User-agent: *
Disallow: /myfolder/mypage.html
Disallow: /cgi-bin/
Sitemap: http://www.yoursite.com/sitemap.gz

this will generate one for you http://www.mcanerin.com/EN/search-engine/robots-txt.asp

if you dont know anything about robots.txt, search on google to find out exacelly what it is for
Reply With Quote