S3, local filesystem) Robust encoding support and auto-detection, for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own efficient XML and HTML parser parsel [https://pypi.python.org/pypi/parsel], an HTML/XML data extraction library written on top of lxml, w3lib [https://pypi.python.org/pypi/w3lib], a multi-purpose helper for dealing you can also use the re() method to extract using regular expressions [https://docs.python.org/3/library/re.html]: >>> response.css('title::text').re(r'Quotes.*') ['Quotes to Scrape'] >>> response.css('title::text')

S3, local filesystem) Robust encoding support and auto-detection, for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own efficient XML and HTML parser parsel [https://pypi.python.org/pypi/parsel], an HTML/XML data extraction library written on top of lxml, w3lib [https://pypi.python.org/pypi/w3lib], a multi-purpose helper for dealing you can also use the re() method to extract using regular expressions [https://docs.python.org/3/library/re.html]: >>> response.css('title::text').re(r'Quotes.*') ['Quotes to Scrape'] >>> response.css('title::text')

html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio]-powered libraries. Extending S3, local filesystem) Robust encoding support and auto-detection, for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own efficient XML and HTML parser parsel [https://pypi.org/project/parsel/], an HTML/XML data extraction library written on top of lxml, w3lib [https://pypi.org/project/w3lib/], a multi-purpose helper for dealing

html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio]-powered libraries. Extending S3, local filesystem) Robust encoding support and auto-detection, for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own efficient XML and HTML parser parsel [https://pypi.org/project/parsel/], an HTML/XML data extraction library written on top of lxml, w3lib [https://pypi.org/project/w3lib/], a multi-purpose helper for dealing

html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio]-powered libraries. Extending S3, local filesystem) Robust encoding support and auto-detection, for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own efficient XML and HTML parser parsel [https://pypi.org/project/parsel/], an HTML/XML data extraction library written on top of lxml, w3lib [https://pypi.org/project/w3lib/], a multi-purpose helper for dealing

html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio]-powered libraries. Extending S3, local filesystem) Robust encoding support and auto-detection, for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own efficient XML and HTML parser parsel [https://pypi.org/project/parsel/], an HTML/XML data extraction library written on top of lxml, w3lib [https://pypi.org/project/w3lib/], a multi-purpose helper for dealing

html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio]-powered libraries. Extending S3, local filesystem) Robust encoding support and auto-detection, for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own efficient XML and HTML parser parsel [https://pypi.org/project/parsel/], an HTML/XML data extraction library written on top of lxml, w3lib [https://pypi.org/project/w3lib/], a multi-purpose helper for dealing

restriction and more Robust encoding support and auto-detection, for dealing with foreign, non- standard and broken encoding declarations. Extensible stats collection for multiple spider metrics, useful you can access the values of their fields (attributes of the class we defined earlier) using the standard dict syntax like: >>> item = DmozItem() >>> item['title'] = 'Example title' >>> item['title'] 'Example build XML applications fast, Python tutorial, DOM and SAX, new Pyxie open source XML processing library. [Prentice Hall PTR]\n'], link= [u'http://www.informit.com/store/product.aspx?isbn=0130211192'],

html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio]-powered libraries. Extending S3, local filesystem) Robust encoding support and auto-detection, for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own efficient XML and HTML parser parsel [https://pypi.org/project/parsel/], an HTML/XML data extraction library written on top of lxml, w3lib [https://pypi.org/project/w3lib/], a multi-purpose helper for dealing

html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio]-powered libraries. Extending S3, local filesystem) Robust encoding support and auto-detection, for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own efficient XML and HTML parser parsel [https://pypi.org/project/parsel/], an HTML/XML data extraction library written on top of lxml, w3lib [https://pypi.org/project/w3lib/], a multi-purpose helper for dealing