Jessie (8.0) and above. 2.2. Installation guide 9 Scrapy Documentation, Release 1.5.2 Mac OS X Building Scrapy’s dependencies requires the presence of a C compiler and development headers. On OS X this these dependecies will be built during installation. On OS X, you are likely to face an issue with building Cryptography dependency, solution to this problem is described here, that is to brew install openssl available via self.tag. You can use this to make your spider fetch only quotes with a specific tag, building the URL based on the argument: import scrapy class QuotesSpider(scrapy.Spider): name = "quotes"

Jessie (8.0) and above. 2.2. Installation guide 9 Scrapy Documentation, Release 1.6.0 Mac OS X Building Scrapy’s dependencies requires the presence of a C compiler and development headers. On OS X this these dependecies will be built during installation. On OS X, you are likely to face an issue with building Cryptography dependency, solution to this problem is described here, that is to brew install openssl available via self.tag. You can use this to make your spider fetch only quotes with a specific tag, building the URL based on the argument: import scrapy (continues on next page) 2.3. Scrapy Tutorial 21

non-Python dependencies can be used to install Scrapy in Debian Jessie (8.0) and above. Mac OS X Building Scrapy’s dependencies requires the presence of a C compiler and development headers. On OS X this these dependecies will be built during installation. On OS X, you are likely to face an issue with building Cryptography dependency, solution to this problem is described here [https://github.com/pyca/cr available via self.tag. You can use this to make your spider fetch only quotes with a specific tag, building the URL based on the argument: import scrapy class QuotesSpider(scrapy.Spider): name = "quotes"

Jessie (8.0) and above. 2.2. Installation guide 9 Scrapy Documentation, Release 1.7.4 Mac OS X Building Scrapy’s dependencies requires the presence of a C compiler and development headers. On OS X this these dependecies will be built during installation. On OS X, you are likely to face an issue with building Cryptography dependency, solution to this problem is described here, that is to brew install openssl available via self.tag. You can use this to make your spider fetch only quotes with a specific tag, building the URL based on the argument: import scrapy (continues on next page) 2.3. Scrapy Tutorial 21

Jessie (8.0) and above. 2.2. Installation guide 9 Scrapy Documentation, Release 1.8.4 Mac OS X Building Scrapy’s dependencies requires the presence of a C compiler and development headers. On OS X this these dependecies will be built during installation. On OS X, you are likely to face an issue with building Cryptography dependency, solution to this problem is described here, that is to brew install openssl available via self.tag. You can use this to make your spider fetch only quotes with a specific tag, building the URL based on the argument: import scrapy class QuotesSpider(scrapy.Spider): name = "quotes"

non-Python dependencies can be used to install Scrapy in Debian Jessie (8.0) and above. macOS Building Scrapy’s dependencies requires the presence of a C compiler and development headers. On macOS this these dependencies will be built during installation. On macOS, you are likely to face an issue with building the Cryptography dependency. The solution to this problem is described here, that is to brew install available via self.tag. You can use this to make your spider fetch only quotes with a specific tag, building the URL based on the argument: import scrapy class QuotesSpider(scrapy.Spider): name = "quotes"

non-Python dependencies can be used to install Scrapy in Debian Jessie (8.0) and above. macOS Building Scrapy’s dependencies requires the presence of a C compiler and development headers. On macOS this these dependencies will be built during installation. On macOS, you are likely to face an issue with building the Cryptography dependency. The solution to this problem is described here, that is to brew install available via self.tag. You can use this to make your spider fetch only quotes with a specific tag, building the URL based on the argument: import scrapy class QuotesSpider(scrapy.Spider): name = "quotes"

non-Python dependencies can be used to install Scrapy in Debian Jessie (8.0) and above. macOS Building Scrapy’s dependencies requires the presence of a C compiler and development headers. On macOS this these dependencies will be built during installation. On macOS, you are likely to face an issue with building the Cryptography dependency. The solution to this problem is described here, that is to brew install available via self.tag. You can use this to make your spider fetch only quotes with a specific tag, building the URL based on the argument: import scrapy class QuotesSpider(scrapy.Spider): name = "quotes"

non-Python dependencies can be used to install Scrapy in Debian Jessie (8.0) and above. macOS Building Scrapy’s dependencies requires the presence of a C compiler and development headers. On macOS this these dependencies will be built during installation. On macOS, you are likely to face an issue with building the Cryptography dependency. The solution to this problem is described here, that is to brew install available via self.tag. You can use this to make your spider fetch only quotes with a specific tag, building the URL based on the argument: import scrapy class QuotesSpider(scrapy.Spider): name = "quotes"

Deploying your project Deploying your project into a Scrapyd server typically involves two steps: 1. building a Python egg [http://peak.telecommunity.com/DevCenter/PythonEggs] of your project. This is called simplest way to deploy your project is by using the deploy command, which automates the process of building the egg uploading it using the Scrapyd HTTP JSON API. The deploy command supports multiple targets py settings.py spiders/ ... Egg caveats There are some things to keep in mind when building eggs of your Scrapy project: make sure no local development settings are included in the egg when