User-agents

Agent guides

• user-agents.net
• developers.whatismybrowser.com
  • See “Parse this user agent” and “Explore user agents”
• abuseme.nl/botreports/

Specific search engines

• DuckDuckBot Web Robot
• Bing crawlers
  • documentation
• Google bots
  • documentation