A Googlebot is a search bot, used by Google. It collects documents from the web to build a searchable index for the Google search engine.

If a webmaster does not want to have any of the information on their site downloaded by a Googlebot, they can do so by inserting a robots.txt file, which can stop Googlebot and other web-crawling robots from caching their site.

External Links

• Googlebot's Unofficial Private Homepage (in German)
• Google's official Googlebot FAQ