Hi,
I was wondering if anyone had any knowledge about how to hide urls from search engines and the curious.
I have a number of pages in development which I don't want to display quite yet. The obvious way is to implement a robots.txt file. However, this is easily viewable and the 'curious' user would be able to go straight to the url. i.e.
www.natwest.co.uk/robots.txt brings up the folders that they want to hide.
the other option is to use robots meta data to hide the page. however, does this also hide the folder url?
i.e. if implemented it will hide
www.webaddress.com/folder/default.asp but will it also hide
www.webaddress.com/folder/
So I have probably confused you all, but in summery, I want to hide both the page and its associated file path. (
www.webaddress.com/folder/default.asp and
www.webaddress.com/folder/) and want to know if the meta tag for robots will do this
Any suggestions would be appreciated.
Thanks,
Stew