See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy.cfg or c:\scrapy\scrapy.cfg settings attributes in the new instance so they can be accessed later inside the spider’s code. Parameters • crawler (Crawler instance) – crawler to which the spider will be bound • args (list) – arguments a Request object, an item object, an iterable of Request objects and/or item objects, or None. Parameters response (Response) – the response to parse log(message[, level, component]) Wrapper that sends

See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy.cfg or c:\scrapy\scrapy.cfg settings attributes in the new instance so they can be accessed later inside the spider’s code. Parameters • crawler (Crawler instance) – crawler to which the spider will be bound • args (list) – arguments a Request object, an item object, an iterable of Request objects and/or item objects, or None. Parameters response (Response) – the response to parse log(message[, level, component]) Wrapper that sends

See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy.cfg or c:\scrapy\scrapy.cfg settings attributes in the new instance so they can be accessed later inside the spider’s code. Parameters • crawler (Crawler instance) – crawler to which the spider will be bound • args (list) – arguments as well as any other Request callback, must return an iterable of Request and/or item objects. Parameters response (Response) – the response to parse log(message[, level, component]) Wrapper that sends

See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy.cfg or c:\scrapy\scrapy.cfg settings attributes in the new instance so they can be accessed later inside the spider’s code. Parameters • crawler (Crawler instance) – crawler to which the spider will be bound • args (list) – arguments a Request object, an item object, an iterable of Request objects and/or item objects, or None. Parameters response (Response) – the response to parse log(message[, level, component]) Wrapper that sends

See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy.cfg or c:\scrapy\scrapy.cfg settings attributes in the new instance so they can be accessed later inside the spider’s code. Parameters • crawler (Crawler instance) – crawler to which the spider will be bound • args (list) – arguments a Request object, an item object, an iterable of Request objects and/or item objects, or None. Parameters response (Response) – the response to parse log(message[, level, component]) Wrapper that sends

See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy.cfg or c:\scrapy\scrapy.cfg are available in the start_requests() method, handlers of the engine_started signal and later. Parameters • crawler (Crawler instance) – crawler to which the spider will be bound • args (list) – arguments a Request object, an item object, an iterable of Request objects and/or item objects, or None. Parameters response (Response) – the response to parse log(message[, level, component]) Wrapper that sends

See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy.cfg or c:\scrapy\scrapy.cfg are available in the start_requests() method, handlers of the engine_started signal and later. Parameters • crawler (Crawler instance) – crawler to which the spider will be bound • args (list) – arguments a Request object, an item object, an iterable of Request objects and/or item objects, or None. Parameters response (Response) – the response to parse log(message[, level, component]) Wrapper that sends

See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy.cfg or c:\scrapy\scrapy.cfg are available in the start_requests() method, handlers of the engine_started signal and later. Parameters • crawler (Crawler instance) – crawler to which the spider will be bound • args (list) – arguments a Request object, an item object, an iterable of Request objects and/or item objects, or None. Parameters response (Response) – the response to parse log(message[, level, component]) Wrapper that sends

See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy.cfg or c:\scrapy\scrapy.cfg settings attributes in the new instance so they can be accessed later inside the spider’s code. Parameters • crawler (Crawler instance) – crawler to which the spider will be bound • args (list) – arguments as well as any other Request callback, must return an iterable of Request and/or item objects. Parameters response (Response) – the response to parse log(message[, level, component]) Wrapper that sends

This method, as well as any other Request callback, must return an iterable of Item objects. Parameters: response – the response to parse log(message[, level, component]) Log a message using the scrapy links must match to be extracted. All those filters are configured through these constructor parameters: Parameters: allow (a regular expression (or list of)) – a single regular expression (or list of regular class for the SgmlLinkExtractor. You should use that one instead. The constructor arguments are: Parameters: tag (str or callable) – either a string (with the name of a tag) or a function that receives a