Morph MORPH
SIGN IN SIGN UP
python / cpython UNCLAIMED

The Python programming language

0 0 1 Python

Issue #16099: RobotFileParser now supports Crawl-delay and Request-rate

extensions.

Patch by Nikolay Bogoychev.
B
Berker Peksag committed
960e848f0d32399824d61dce2ff5736bb596ed44
Parent: 2137dc1