Bots
botscout.com
[weblink] Submitted by Michael on 9. March 2009 - 5:03 (9. March 2009 - 5:04)
BotScout helps prevent automated web scripts, known as "bots", from registering on forums, polluting databases, spreading spam, and abusing forms on web sites. We do this by tracking the names, IPs, and email addresses that bots use and logging them for future comparison. We also provide a simple API that you can use to test forms when they're submitted on your site.
robotstxt.org
[weblink] Submitted by Michael on 30. May 2008 - 22:37 (14. December 2009 - 5:09)
This is the main source for information on the robots.txt Robots Exclusion Standard and other articles about writing well-behaved Web robots.
Bots vs Browsers
[weblink] Submitted by Michael on 30. May 2008 - 21:04 (19. January 2009 - 7:27)
Bots vs Browsers - Public Bots and User Agents Database and Commentary
