web crawler not following links

[nate2099]

I've tried various crawlers on this site:
http://www.freelancetechaustralia.com.au/index.htm

and none of them will follow the links on this dynamically generated page (and others)
http://www.freelancetechaustralia.co...dio_Technician

The right hand side menu are indexed fine, but not the name links under each image, or the 'refine search' links. This page is only 2 links deep.

links are being generated by this code:

Code: Select all

echo "| <a href='".$_SERVER['PHP_SELF']."?c3=$states[$i]&$query_string2' >$states[$i] </a>";
and
echo "<li> <a href='".$_SERVER['PHP_SELF']."?c4=$regions[$i]&$query_string2' >$regions[$i] </a></li>";

incase it helps...


Can anyone suggest why?

[nate2099]

Problem turned out to be with session variables. I have a session variable to set what country the user wants to see. Unfortunately the crawler does level 1 links, then level 2 links, etc, which doesn't retain the country session variable. (whereas a user would click on a level 1 link - sets country variable - level 2 link - same country variable - level 3 link gets reached with the appropriate country variable.)

Can I expect googles crawler to act similar to the sitemap crawler, or does it actually follow links in succession?

I hope this makes sense...?