They're really only looking for "live" text and images to both index and rank your respective pages.

You should use both the meta tag and robots.txt file

<meta name="robots" content="index, follow" />

http://www.gnc-web-creations.com/cre...tstxt_file.htm