protego

PyPI page
Home page
Author: None
Summary: Pure-Python robots.txt parser with support for modern conventions
Latest version: 0.6.2


Downloads last day: 759,195
Downloads last week: 8,940,681
Downloads last month: 24,263,629