Quote:
Originally Posted by RohanShenoy
Even if its a lazy man's way, it still needed some brain atleast more than what is needed for hand-coding it. And moreover, how many links are you gonna convert that way? What is the use of having so many functions if we can't automate the tasks.
|
Server side scripting is meant for automation. Client side scripting is meant add functionality to the site, but everything should work without it.
Quote:
Originally Posted by RohanShenoy
Why would one want to record where a SE bot left for? They would anyways follow all links.
|
You want to stop the crawler from following the links out of the page. So you use robots.txt to stop the crawler from going to redirect.
php, thereby stopping it from going out of the site. But crawlers don't use javascript, so they can go straight to the outside site.