spiders. Coroutines Use the coroutine syntax [https://docs.python.org/3/reference/compound_stmts.html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio downloaded by Scrapy and then their response handled by the specified callback. 3. In callback functions, you parse the page contents, typically using Selectors (but you can also use BeautifulSoup, lxml content as argument to an XPath string function [https://www.w3.org/TR/xpath/all/#section-String-Functions], avoid using .//text() and use just . instead. This is because the expression .//text() yields

spiders. Coroutines Use the coroutine syntax [https://docs.python.org/3/reference/compound_stmts.html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio downloaded by Scrapy and then their response handled by the specified callback. 3. In callback functions, you parse the page contents, typically using Selectors (but you can also use BeautifulSoup, lxml content as argument to an XPath string function [https://www.w3.org/TR/xpath/all/#section-String-Functions], avoid using .//text() and use just . instead. This is because the expression .//text() yields

spiders. Coroutines Use the coroutine syntax [https://docs.python.org/3/reference/compound_stmts.html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio downloaded by Scrapy and then their response handled by the specified callback. 3. In callback functions, you parse the page contents, typically using Selectors (but you can also use BeautifulSoup, lxml content as argument to an XPath string function [https://www.w3.org/TR/xpath/all/#section-String-Functions], avoid using .//text() and use just . instead. This is because the expression .//text() yields

spiders. Coroutines Use the coroutine syntax [https://docs.python.org/3/reference/compound_stmts.html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio downloaded by Scrapy and then their response handled by the specified callback. 3. In callback functions, you parse the page contents, typically using Selectors (but you can also use BeautifulSoup, lxml content as argument to an XPath string function [https://www.w3.org/TR/xpath/all/#section-String-Functions], avoid using .//text() and use just . instead. This is because the expression .//text() yields

spiders. Coroutines Use the coroutine syntax [https://docs.python.org/3/reference/compound_stmts.html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio downloaded by Scrapy and then their response handled by the specified callback. 3. In callback functions, you parse the page contents, typically using Selectors (but you can also use BeautifulSoup, lxml content as argument to an XPath string function [https://www.w3.org/TR/xpath/all/#section-String-Functions], avoid using .//text() and use just . instead. This is because the expression .//text() yields

spiders. Coroutines Use the coroutine syntax [https://docs.python.org/3/reference/compound_stmts.html#async]. asyncio Use asyncio [https://docs.python.org/3/library/asyncio.html#module-asyncio] and asyncio downloaded by Scrapy and then their response handled by the specified callback. 3. In callback functions, you parse the page contents, typically using Selectors (but you can also use BeautifulSoup, lxml content as argument to an XPath string function [https://www.w3.org/TR/xpath/all/#section-String-Functions], avoid using .//text() and use just . instead. This is because the expression .//text() yields

the specified callback. 3.2. Spiders 35 Scrapy Documentation, Release 2.10.1 3. In callback functions, you parse the page contents, typically using Selectors (but you can also use BeautifulSoup, lxml regular expressions so lxml’s implementation uses hooks to Python’s re module. Thus, using regexp functions in your XPath expressions may add a small performance penalty. Set operations These can be handy input and output processors must receive an iterable as their first argument. The output of those functions can be anything. The result of input processors will be appended to an internal list (in the Loader)

the specified callback. 3.2. Spiders 35 Scrapy Documentation, Release 2.11.1 3. In callback functions, you parse the page contents, typically using Selectors (but you can also use BeautifulSoup, lxml regular expressions so lxml’s implementation uses hooks to Python’s re module. Thus, using regexp functions in your XPath expressions may add a small performance penalty. Set operations These can be handy input and output processors must receive an iterable as their first argument. The output of those functions can be anything. The result of input processors will be appended to an internal list (in the Loader)

the specified callback. 3.2. Spiders 35 Scrapy Documentation, Release 2.11.1 3. In callback functions, you parse the page contents, typically using Selectors (but you can also use BeautifulSoup, lxml regular expressions so lxml’s implementation uses hooks to Python’s re module. Thus, using regexp functions in your XPath expressions may add a small performance penalty. Set operations These can be handy input and output processors must receive an iterable as their first argument. The output of those functions can be anything. The result of input processors will be appended to an internal list (in the Loader)

the specified callback. 3.2. Spiders 35 Scrapy Documentation, Release 2.11.1 3. In callback functions, you parse the page contents, typically using Selectors (but you can also use BeautifulSoup, lxml regular expressions so lxml’s implementation uses hooks to Python’s re module. Thus, using regexp functions in your XPath expressions may add a small performance penalty. Set operations These can be handy input and output processors must receive an iterable as their first argument. The output of those functions can be anything. The result of input processors will be appended to an internal list (in the Loader)