|
Re: Robot Questions
I exclude the URLs that I don't want to be indexed and then created the sitemap which is then uploaded to Google. Would Googlebot still crawl those URLs since I don't have the robots file? I should make the robots file for other bots then?
|