index modules | next | Scrapy 0.20.2 documentation » Scrapy 0.20 documentation This documentation contains everything you need to know about Scrapy. Getting help Having trouble? We’d like to help! 2008-2013, Scrapy developers. Last updated on Sep 18, 2014. Created using Sphinx 1.2.2. index modules | next | previous | Scrapy 0.20.2 documentation » Scrapy at a glance Scrapy is an application framework 2008-2013, Scrapy developers. Last updated on Sep 18, 2014. Created using Sphinx 1.2.2. index modules | next | previous | Scrapy 0.20.2 documentation » Installation guide Pre-requisites The installation

index modules | next | Scrapy 0.18.4 documentation » Scrapy 0.18 documentation This documentation contains everything you need to know about Scrapy. Getting help Having trouble? We’d like to help! 2008-2013, Scrapy developers. Last updated on May 12, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.18.4 documentation » Scrapy at a glance Scrapy is an application framework 2008-2013, Scrapy developers. Last updated on May 12, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.18.4 documentation » Installation guide Pre-requisites The installation

index modules | next | Scrapy 0.9 documentation » Scrapy 0.9 documentation This documentation contains everything you need to know about Scrapy. Getting help Having trouble? We’d like to help! Try Copyright 2008-2010, Insophia. Last updated on May 12, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.9 documentation » Scrapy at a glance Scrapy a is an application framework Copyright 2008-2010, Insophia. Last updated on May 12, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.9 documentation » Installation guide This document describes how to

index modules | next | Scrapy 0.16.5 documentation » Scrapy 0.16 documentation This documentation contains everything you need to know about Scrapy. Getting help Having trouble? We’d like to help! Copyright 2008-2012, Scrapinghub. Last updated on May 12, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.16.5 documentation » Scrapy at a glance Scrapy is an application framework Copyright 2008-2012, Scrapinghub. Last updated on May 12, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.16.5 documentation » Installation guide Pre-requisites The installation

index modules | next | Scrapy 0.14.4 documentation » Scrapy 0.14 documentation This documentation contains everything you need to know about Scrapy. Getting help Having trouble? We’d like to help! Copyright 2008-2011, Insophia. Last updated on May 12, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.14.4 documentation » Scrapy at a glance Scrapy is an application framework Copyright 2008-2011, Insophia. Last updated on May 12, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.14.4 documentation » Installation guide This document describes how

index modules | next | Scrapy 0.22.0 documentation » Scrapy 0.22 documentation This documentation contains everything you need to know about Scrapy. Getting help Having trouble? We’d like to help! Copyright 2008-2013, Scrapy developers. Last updated on Jan 17, 2014. Created using Sphinx 1.2. index modules | next | previous | Scrapy 0.22.0 documentation » Scrapy at a glance Scrapy is an application framework Copyright 2008-2013, Scrapy developers. Last updated on Jan 17, 2014. Created using Sphinx 1.2. index modules | next | previous | Scrapy 0.22.0 documentation » Installation guide Pre-requisites The installation

index modules | next | Scrapy 0.12.0 documentation » Scrapy 0.12 documentation This documentation contains everything you need to know about Scrapy. Getting help Having trouble? We’d like to help! Copyright 2008-2011, Insophia. Last updated on May 12, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.12.0 documentation » Scrapy at a glance Scrapy is an application framework Copyright 2008-2011, Insophia. Last updated on May 12, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.12.0 documentation » Installation guide This document describes how

index modules | next | Scrapy 0.24.6 documentation » Scrapy 0.24 documentation This documentation contains everything you need to know about Scrapy. Getting help Having trouble? We’d like to help! 2008-2013, Scrapy developers. Last updated on Apr 07, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.24.6 documentation » Scrapy at a glance Scrapy is an application framework 2008-2013, Scrapy developers. Last updated on Apr 07, 2016. Created using Sphinx 1.3.5. index modules | next | previous | Scrapy 0.24.6 documentation » Installation guide Installing Scrapy Note Check

version 1.3.3. Default: False By default, when scrapy tries to import spider classes from SPIDER_MODULES, it will fail loudly if there is any ImportError exception. But you can choose to silence this exception info see Activating a spider middleware. SPIDER_MODULES Default: [] A list of modules where Scrapy will look for spiders. Example: SPIDER_MODULES = ['mybot.spiders_prod', 'mybot.spiders_dev'] STATS_CLASS SPIDER_LOADER_CLASS • SPIDER_LOADER_WARN_ONLY • SPIDER_MIDDLEWARES • SPIDER_MIDDLEWARES_BASE • SPIDER_MODULES • STATSMAILER_RCPTS • STATS_CLASS • STATS_DUMP • TELNETCONSOLE_ENABLED • TELNETCONSOLE_HOST

with its own settings module. In that case, you must define one or more aliases for those settings modules under [settings] in your scrapy. cfg file: [settings] default = myproject1.settings project1 = myproject1 version 1.3.3. Default: False By default, when scrapy tries to import spider classes from SPIDER_MODULES, it will fail loudly if there is any ImportError exception. But you can choose to silence this exception info see Activating a spider middleware. SPIDER_MODULES Default: [] A list of modules where Scrapy will look for spiders. Example: SPIDER_MODULES = ['mybot.spiders_prod', 'mybot.spiders_dev'] 116