Tag Archives: crawlers

Putting all crawler access in a separate apache2 log file?

Posted on April 27, 2010 by slacy

Is there an easy way to configure apache2 so that all known crawler accesses (googlebot, yahoo slurp, etc) all go into their own log file, and everything else remains in the regular .log file?  I’m hoping for something like “access.log”, … Continue reading →

Posted in General | Tagged , , , | 1 Comment

(stopping the) Invasion of the Chinese Bandwidth Leeches.

Posted on January 26, 2008 by slacy

Ever since I setup mrtg on my OpenWRT router, I’ve been noticing that between 2pm and 8pm PST, there’s a huge spike in my outgoing bandwidth. I’ve been trying to track it down, and briefly suspected it was my TiVoHD … Continue reading →

Posted in General | Tagged , , , , , , , | 5 Comments