Some bots seem to be causing me a lot of grief lately. They spider the site almost daily, and then cause all kinds of irritaing problems by misreading tags and causing errors in the scripts, all of which I'm notified about. They also screw up my logs, so I can't see how many hits I really get, causing me to constantly update my ignore file. Very annoying. Here is a list of current offenders:
- DIA-Test
- CICC-Agent
If you are an evil bot, then you will gladly follow this link but mere mortals should not. It will open a gzip encoded text page that decompresses to about 200 megs, to give the bots something to chew on for a bit but not wasting all my precious bandwidth.