| /external/python/cpython2/Doc/library/ |
| D | robotparser.rst | 2 :mod:`robotparser` --- Parser for robots.txt
5 .. module:: robotparser
18 The :mod:`robotparser` module has been renamed :mod:`urllib.robotparser` in
71 >>> import robotparser
72 >>> rp = robotparser.RobotFileParser()
|
| D | fileformats.rst | 16 robotparser.rst
|
| /external/python/cpython3/Lib/test/ |
| D | test_robotparser.py | 5 import urllib.robotparser
18 self.parser = urllib.robotparser.RobotFileParser()
91 urllib.robotparser.RequestRate
114 request_rate = urllib.robotparser.RequestRate(9, 30)
243 request_rate = urllib.robotparser.RequestRate(3, 15)
310 parser = urllib.robotparser.RobotFileParser()
325 cls.parser = urllib.robotparser.RobotFileParser(cls.robots_txt)
349 parser = urllib.robotparser.RobotFileParser(self.url('i-robot.txt'))
|
| /external/python/cpython2/Lib/test/ |
| D | test_robotparser.py | 2 import robotparser
21 self.parser = robotparser.RobotFileParser()
199 parser = robotparser.RobotFileParser()
214 cls.parser = robotparser.RobotFileParser(cls.robots_txt)
236 parser = robotparser.RobotFileParser(self.url('i-robot.txt'))
|
| /external/python/cpython3/Doc/library/ |
| D | urllib.robotparser.rst | 1 :mod:`urllib.robotparser` --- Parser for robots.txt
4 .. module:: urllib.robotparser
10 **Source code:** :source:`Lib/urllib/robotparser.py`
83 >>> import urllib.robotparser
84 >>> rp = urllib.robotparser.RobotFileParser()
|
| D | urllib.rst | 15 * :mod:`urllib.robotparser` for parsing ``robots.txt`` files
|
| D | internet.rst | 30 urllib.robotparser.rst
|
| /external/python/cpython2/Misc/NEWS.d/next/Library/ |
| D | 2018-04-02-20-44-54.bpo-32861.HeBjzN.rst | 1 The urllib.robotparser's ``__str__`` representation now includes wildcard
|
| /external/python/cpython2/Tools/webchecker/ |
| D | README | 11 - Jan 1997. First release. The module robotparser.py was written by
|
| D | webchecker.py | 122 import robotparser
332 self.robots[root] = rp = robotparser.RobotFileParser()
|
| /external/python/cpython2/Misc/NEWS.d/ |
| D | 2.6b2.rst | 394 Document that robotparser has been renamed to urllib.robotparser in Python
|
| D | 2.6b3.rst | 414 Bug fix in robotparser parsing of Allow: lines.
|
| D | 2.7.6rc1.rst | 682 urllib.parse.robotparser normalizes the urls before adding to ruleline. This
|
| D | 2.7.7rc1.rst | 157 Reduced the risk of false positives in robotparser by checking to make sure
|
| D | 2.7.1rc1.rst | 945 In urllib.robotparser, if there are multiple 'User-agent: *' entries,
|
| /external/python/six/documentation/ |
| D | index.rst | 668 | ``urllib.robotparser`` | :mod:`py2:robotparser` | :mod:`py3:urllib.robotparser…
670 | ``urllib_robotparser`` | :mod:`py2:robotparser` | :mod:`py3:urllib.robotparser…
|
| /external/python/six/ |
| D | test_six.py | 186 assert item_name in dir(six.moves.urllib.robotparser)
187 getattr(six.moves.urllib.robotparser, item_name)
|
| D | six.py | 483 robotparser = _importer._get_module("moves.urllib_robotparser") variable in Module_six_moves_urllib
|
| /external/python/setuptools/pkg_resources/_vendor/ |
| D | six.py | 477 robotparser = _importer._get_module("moves.urllib_robotparser") variable in Module_six_moves_urllib
|
| /external/python/setuptools/setuptools/_vendor/ |
| D | six.py | 477 robotparser = _importer._get_module("moves.urllib_robotparser") variable in Module_six_moves_urllib
|
| /external/scapy/scapy/modules/ |
| D | six.py | 487 robotparser = _importer._get_module("moves.urllib_robotparser") variable in Module_six_moves_urllib
|
| /external/python/cpython3/Misc/NEWS.d/ |
| D | 3.7.0b5.rst | 439 The urllib.robotparser's ``__str__`` representation now includes wildcard
|
| D | 3.6.6rc1.rst | 398 The urllib.robotparser's ``__str__`` representation now includes wildcard
|
| D | 3.6.4rc1.rst | 309 :meth:`RobotFileParser.parse() <urllib.robotparser.RobotFileParser.parse>`
|
| D | 3.7.0a3.rst | 389 :meth:`RobotFileParser.parse() <urllib.robotparser.RobotFileParser.parse>`
|