represent nodes in the document structure. So, the first instantiated selectors are associated to the root node, or the entire document. Selectors have three methods (click on the method to see the complete API call returns a list of selectors, so we can concatenate further select() calls to dig deeper into a node. We are going to use that property here, so: sites = hxs.select('//ul/li') for site in sites: XMLFeedSpider XMLFeedSpider is designed for parsing XML feeds by iterating through them by a certain node name. The iterator can be chosen from: iternodes, xml, and html. It’s recommended to use the iternodes

represent nodes in the document structure. So, the first instantiated selectors are associated to the root node, or the entire document. Selectors have three methods (click on the method to see the complete API call returns a list of selectors, so we can concatenate further select() calls to dig deeper into a node. We are going to use that property here, so: sites = hxs.select('//ul/li') for site in sites: title XMLFeedSpider XMLFeedSpider is designed for parsing XML feeds by iterating through them by a certain node name. The iterator can be chosen from: iternodes, xml, and html. It’s recommended to use the iternodes

represent nodes in the document structure. So, the first instantiated selectors are associated to the root node, or the entire document. Selectors have three methods (click on the method to see the complete API call returns a list of selectors, so we can concatenate further select() calls to dig deeper into a node. We are going to use that property here, so: sites = hxs.select('//ul/li') for site in sites: XMLFeedSpider XMLFeedSpider is designed for parsing XML feeds by iterating through them by a certain node name. The iterator can be chosen from: iternodes, xml, and html. It’s recommended to use the iternodes

represent nodes in the document structure. So, the first instantiated selectors are associated to the root node, or the entire document. Selectors have three methods (click on the method to see the complete API call returns a list of selectors, so we can concatenate further select() calls to dig deeper into a node. We are going to use that property here, so: sites = hxs.select('//ul/li') for site in sites: title XMLFeedSpider XMLFeedSpider is designed for parsing XML feeds by iterating through them by a certain node name. The iterator can be chosen from: iternodes, xml, and html. It’s recommended to use the iternodes

represent nodes in the document structure. So, the first instantiated selectors are associated to the root node, or the entire document. Selectors have three methods (click on the method to see the complete API call returns a list of selectors, so we can concatenate further select() calls to dig deeper into a node. We are going to use that property here, so: sites = hxs.select('//ul/li') for site in sites: title XMLFeedSpider XMLFeedSpider is designed for parsing XML feeds by iterating through them by a certain node name. The iterator can be chosen from: iternodes, xml, and html. It’s recommended to use the iternodes

represent nodes in the document structure. So, the first instantiated selectors are associated to the root node, or the entire document. Selectors have three methods (click on the method to see the complete API call returns a list of selectors, so we can concatenate further select() calls to dig deeper into a node. We are going to use that property here, so: sites = hxs.select('//ul/li') for site in sites: XMLFeedSpider XMLFeedSpider is designed for parsing XML feeds by iterating through them by a certain node name. The iterator can be chosen from: iternodes, xml, and html. It’s recommended to use the iternodes

COMMANDS_MODULE = 'mybot.commands' Register commands via setup.py entry points Note This is an experimental feature, use with caution. You can also add Scrapy commands from an external library by adding a scrapy XMLFeedSpider XMLFeedSpider is designed for parsing XML feeds by iterating through them by a certain node name. The iterator can be chosen from: iternodes, xml, and html. It’s recommended to use the iternodes could be a problem for big feeds It defaults to: 'iternodes'. itertag A string with the name of the node (or element) to iterate in. Example: itertag = 'product' namespaces A list of (prefix, uri) tuples

nodes in the document structure. So, the first instantiated selectors are associated with the root node, or the entire document. Selectors have four basic methods (click on the method to see the complete call returns a list of selectors, so we can concatenate further .xpath() calls to dig deeper into a node. We are going to use that property here, so: for sel in response.xpath('//ul/li'): title = sel.xpath('a/text()') COMMANDS_MODULE = 'mybot.commands' Register commands via setup.py entry points Note: This is an experimental feature, use with caution. You can also add Scrapy commands from an external library by adding a scrapy

COMMANDS_MODULE = 'mybot.commands' Register commands via setup.py entry points Note: This is an experimental feature, use with caution. You can also add Scrapy commands from an external library by adding a scrapy XMLFeedSpider XMLFeedSpider is designed for parsing XML feeds by iterating through them by a certain node name. The iterator can be chosen from: iternodes, xml, and html. It’s recommended to use the iternodes Chapter 3. Basic concepts Scrapy Documentation, Release 1.6.0 itertag A string with the name of the node (or element) to iterate in. Example: itertag = 'product' namespaces A list of (prefix, uri) tuples

COMMANDS_MODULE = 'mybot.commands' Register commands via setup.py entry points Note: This is an experimental feature, use with caution. You can also add Scrapy commands from an external library by adding a scrapy XMLFeedSpider XMLFeedSpider is designed for parsing XML feeds by iterating through them by a certain node name. The iterator can be chosen from: iternodes, xml, and html. It’s recommended to use the iternodes could be a problem for big feeds It defaults to: 'iternodes'. itertag A string with the name of the node (or element) to iterate in. Example: itertag = 'product' namespaces A list of (prefix, uri) tuples