python-robot-detection 0.4 Detect web crawlers
robot_detection is a python module to detect if a given HTTP User Agent is a web crawler. It uses the list of registered robots from http://www.robotstxt.org.
- Website: https://github.com/rory/robot-detection
- License: GPL 3+
- Package source: python-web.scm
- Patches: None
- Builds: x86_64-linux, i686-linux