I've gotta try this. Those bad guys keep coming back!
This is good information. However the best way to keep a bad robot from stripping you email address is to use a contact form and not have an email address in text on your website.
imma gonna try that NOW!!!
All about creepy crawlers, and I'm not talking about insects.
great help for web admins
seems very usefull
Would that work? I hope.
You pretty much have to run your own web server for this to be useful. If you do, I strongly suggest it, especially if you pay by bandwidth usage.
Just not interested. Patt
The page is old, the idea is great, the suggested implementation is too narrow and dangerous (#exec cmd="sleed 20" - Server Side Includes?)
For a good link on robots, see http://www.robotstxt.org/wc/faq.html
The only bad "bots" are written by a terrible coder or a malicious hacker...
excellent resource :)
I love really ugly pages that are full of really useful stuff. This page is soooo ugly a mother couldn't love it, but so useful that I love it.
Nice tips :) I have been wondering how to fool bots that ignore robots.txt :)