instance is bound. Crawlers encapsulate a lot of components in the project for their single entry access (such as extensions, middlewares, signals managers, etc). See Crawler API to know more about them command using the -a option. For example: scrapy crawl myspider -a category=electronics Spiders can access arguments in their __init__ methods: import scrapy class MySpider(scrapy.Spider): name = "myspider" last): ... KeyError: 'Product does not support field: lala' Accessing all populated values To access all populated values, just use the typical dict API: >>> product.keys() ['price', 'name'] >>> product

instance is bound. Crawlers encapsulate a lot of components in the project for their single entry access (such as extensions, middlewares, signals managers, etc). See Crawler API to know more about them command using the -a option. For example: scrapy crawl myspider -a category=electronics Spiders can access arguments in their __init__ methods: import scrapy class MySpider(scrapy.Spider): name = 'myspider' last): ... KeyError: 'Product does not support field: lala' Accessing all populated values To access all populated values, just use the typical dict API: >>> product.keys() ['price', 'name'] >>> product

extract some information from a website, but the website doesn’t provide any API or mechanism to access that info programmatically. Scrapy can help you extract that information. Let’s say we want to extract your output, run: scrapy crawl dmoz Using our item Item objects are custom python dicts; you can access the values of their fields (attributes of the class we defined earlier) using the standard dict syntax last): ... KeyError: 'Product does not support field: lala' Accessing all populated values To access all populated values, just use the typical dict API: >>> product.keys() ['price', 'name'] >>> product

instance is bound. Crawlers encapsulate a lot of components in the project for their single entry access (such as extensions, middlewares, signals managers, etc). See Crawler API to know more about them command using the -a option. For example: scrapy crawl myspider -a category=electronics Spiders can access arguments in their __init__ methods: import scrapy class MySpider(scrapy.Spider): name = "myspider" last): ... KeyError: 'Product does not support field: lala' Accessing all populated values To access all populated values, just use the typical dict API: >>> product.keys() ['price', 'name'] >>> product

instance is bound. Crawlers encapsulate a lot of components in the project for their single entry access (such as extensions, middlewares, signals managers, etc). See Crawler API to know more about them command using the -a option. For example: scrapy crawl myspider -a category=electronics Spiders can access arguments in their __init__ methods: import scrapy class MySpider(scrapy.Spider): name = 'myspider' last): ... KeyError: 'Product does not support field: lala' Accessing all populated values To access all populated values, just use the typical dict API: >>> product.keys() ['price', 'name'] >>> product

instance is bound. Crawlers encapsulate a lot of components in the project for their single entry access (such as extensions, middlewares, signals managers, etc). See Crawler API to know more about them command using the -a option. For example: scrapy crawl myspider -a category=electronics Spiders can access arguments in their __init__ methods: import scrapy class MySpider(scrapy.Spider): name = "myspider" last): ... KeyError: 'Product does not support field: lala' Accessing all populated values To access all populated values, just use the typical dict API: >>> product.keys() ['price', 'name'] >>> product

instance is bound. Crawlers encapsulate a lot of components in the project for their single entry access (such as extensions, middlewares, signals managers, etc). See Crawler API to know more about them command using the -a option. For example: scrapy crawl myspider -a category=electronics Spiders can access arguments in their __init__ methods: import scrapy class MySpider(scrapy.Spider): name = "myspider" last): ... KeyError: 'Product does not support field: lala' Accessing all populated values To access all populated values, just use the typical dict API: >>> product.keys() ['price', 'name'] >>> product

instance is bound. Crawlers encapsulate a lot of components in the project for their single entry access (such as extensions, middlewares, signals managers, etc). See Crawler API to know more about them command using the -a option. For example: scrapy crawl myspider -a category=electronics Spiders can access arguments in their __init__ methods: import scrapy class MySpider(scrapy.Spider): name = "myspider" last): ... KeyError: 'Product does not support field: lala' Accessing all populated values To access all populated values, just use the typical dict API: >>> product.keys() ['price', 'name'] >>> product

instance is bound. Crawlers encapsulate a lot of components in the project for their single entry access (such as extensions, middlewares, signals managers, etc). See Crawler API to know more about them command using the -a option. For example: scrapy crawl myspider -a category=electronics Spiders can access arguments in their __init__ methods: import scrapy class MySpider(scrapy.Spider): name = 'myspider' last): ... KeyError: 'Product does not support field: lala' Accessing all populated values To access all populated values, just use the typical dict API: >>> product.keys() ['price', 'name'] >>> product

extract some information from a website, but the website doesn’t provide any API or mechanism to access that info programmatically. Scrapy can help you extract that information. Let’s say we want to extract your output, run: scrapy crawl dmoz Using our item Item objects are custom python dicts; you can access the values of their fields (attributes of the class we defined earlier) using the standard dict syntax last): ... KeyError: 'Product does not support field: lala' Accessing all populated values To access all populated values, just use the typical dict API [http://docs.python.org/library/stdtypes.html#dict]: