34 Chapter 3. Basic concepts Scrapy Documentation, Release 2.10.1 3.1.6 Custom project commands You can also add your custom project commands by using the COMMANDS_MODULE setting. See the Scrapy commands COMMANDS_MODULE Default: '' (empty string) A module to use for looking up custom Scrapy commands. This is used to add custom commands for your Scrapy project. Example: COMMANDS_MODULE = "mybot.commands" from their pages (i.e. scraping items). In other words, Spiders are the place where you define the custom behaviour for crawling and parsing pages for a particular site (or, in some cases, a group of sites)

34 Chapter 3. Basic concepts Scrapy Documentation, Release 2.11.1 3.1.6 Custom project commands You can also add your custom project commands by using the COMMANDS_MODULE setting. See the Scrapy commands COMMANDS_MODULE Default: '' (empty string) A module to use for looking up custom Scrapy commands. This is used to add custom commands for your Scrapy project. Example: COMMANDS_MODULE = "mybot.commands" from their pages (i.e. scraping items). In other words, Spiders are the place where you define the custom behaviour for crawling and parsing pages for a particular site (or, in some cases, a group of sites)

34 Chapter 3. Basic concepts Scrapy Documentation, Release 2.11.1 3.1.6 Custom project commands You can also add your custom project commands by using the COMMANDS_MODULE setting. See the Scrapy commands COMMANDS_MODULE Default: '' (empty string) A module to use for looking up custom Scrapy commands. This is used to add custom commands for your Scrapy project. Example: COMMANDS_MODULE = "mybot.commands" from their pages (i.e. scraping items). In other words, Spiders are the place where you define the custom behaviour for crawling and parsing pages for a particular site (or, in some cases, a group of sites)

34 Chapter 3. Basic concepts Scrapy Documentation, Release 2.11.1 3.1.6 Custom project commands You can also add your custom project commands by using the COMMANDS_MODULE setting. See the Scrapy commands COMMANDS_MODULE Default: '' (empty string) A module to use for looking up custom Scrapy commands. This is used to add custom commands for your Scrapy project. Example: COMMANDS_MODULE = "mybot.commands" from their pages (i.e. scraping items). In other words, Spiders are the place where you define the custom behaviour for crawling and parsing pages for a particular site (or, in some cases, a group of sites)

• Requires project: no Run a quick benchmark test. Benchmarking. 3.1.6 Custom project commands You can also add your custom project commands by using the COMMANDS_MODULE setting. See the Scrapy commands COMMANDS_MODULE Default: '' (empty string) A module to use for looking up custom Scrapy commands. This is used to add custom commands for your Scrapy project. Example: COMMANDS_MODULE = 'mybot.commands' from their pages (i.e. scraping items). In other words, Spiders are the place where you define the custom behaviour for crawling and parsing pages for a particular site (or, in some cases, a group of sites)

34 Chapter 3. Basic concepts Scrapy Documentation, Release 2.7.1 3.1.6 Custom project commands You can also add your custom project commands by using the COMMANDS_MODULE setting. See the Scrapy commands COMMANDS_MODULE Default: '' (empty string) A module to use for looking up custom Scrapy commands. This is used to add custom commands for your Scrapy project. Example: COMMANDS_MODULE = 'mybot.commands' from their pages (i.e. scraping items). In other words, Spiders are the place where you define the custom behaviour for crawling and parsing pages for a particular site (or, in some cases, a group of sites)

34 Chapter 3. Basic concepts Scrapy Documentation, Release 2.9.0 3.1.6 Custom project commands You can also add your custom project commands by using the COMMANDS_MODULE setting. See the Scrapy commands COMMANDS_MODULE Default: '' (empty string) A module to use for looking up custom Scrapy commands. This is used to add custom commands for your Scrapy project. Example: COMMANDS_MODULE = "mybot.commands" from their pages (i.e. scraping items). In other words, Spiders are the place where you define the custom behaviour for crawling and parsing pages for a particular site (or, in some cases, a group of sites)

34 Chapter 3. Basic concepts Scrapy Documentation, Release 2.8.0 3.1.6 Custom project commands You can also add your custom project commands by using the COMMANDS_MODULE setting. See the Scrapy commands COMMANDS_MODULE Default: '' (empty string) A module to use for looking up custom Scrapy commands. This is used to add custom commands for your Scrapy project. Example: COMMANDS_MODULE = 'mybot.commands' from their pages (i.e. scraping items). In other words, Spiders are the place where you define the custom behaviour for crawling and parsing pages for a particular site (or, in some cases, a group of sites)

Benchmarking. 3.1. Command line tool 31 Scrapy Documentation, Release 2.4.1 3.1.6 Custom project commands You can also add your custom project commands by using the COMMANDS_MODULE setting. See the Scrapy com- COMMANDS_MODULE Default: '' (empty string) A module to use for looking up custom Scrapy commands. This is used to add custom commands for your Scrapy project. Example: COMMANDS_MODULE = 'mybot.commands' from their pages (i.e. scraping items). In other words, Spiders are the place where you define the custom behaviour for crawling and parsing pages for a particular site (or, in some cases, a group of sites)

Middleware Customize the input and output of your spiders. Extensions Extend Scrapy with your custom functionality Signals See all available signals and how to work with them. Scheduler Understand to a file (XML, CSV, etc). Components Learn the common API and some good practices when building custom Scrapy components. Core API Use it on extensions and middlewares to extend Scrapy functionality scrapy bench Requires project: no Run a quick benchmark test. Benchmarking. Custom project commands You can also add your custom project commands by using the COMMANDS_MODULE setting. See the Scrapy commands