'parse_torrent')] def parse_torrent(self, response): x = HtmlXPathSelector(response) torrent = TorrentItem() torrent['url'] = response.url torrent['name'] = x.select("//h1/text()") called with the downloaded Response object of each start URL. The response is passed to the method as the first and only argument. This method is responsible for parsing the response data and extracting scraped data (as scraped items) and more URLs to follow. The parse() method is in charge of processing the response and returning scraped data (as Item objects) and more URLs to follow (as Request objects). This

r/\d+']), 'parse_torrent')] def parse_torrent(self, response): x = HtmlXPathSelector(response) torrent = TorrentItem() torrent['url'] = response.url torrent['name'] = x.select("//h1/text()").extract() called with the downloaded Response object of each start URL. The response is passed to the method as the first and only argument. This method is responsible for parsing the response data and extracting scraped data (as scraped items) and more URLs to follow. The parse() method is in charge of processing the response and returning scraped data (as Item objects) and more URLs to follow (as Request objects). This

'parse_torrent')] def parse_torrent(self, response): x = HtmlXPathSelector(response) torrent = TorrentItem() torrent['url'] = response.url torrent['name'] = x.select("//h1/text()") called with the downloaded Response object of each start URL. The response is passed to the method as the first and only argument. This method is responsible for parsing the response data and extracting scraped data (as scraped items) and more URLs to follow. The parse() method is in charge of processing the response and returning scraped data (as Item objects) and more URLs to follow (as Request objects). This

r/\d+']), 'parse_torrent')] def parse_torrent(self, response): x = HtmlXPathSelector(response) torrent = TorrentItem() torrent['url'] = response.url torrent['name'] = x.select("//h1/text()").extract() called with the downloaded Response object of each start URL. The response is passed to the method as the first and only argument. This method is responsible for parsing the response data and extracting scraped data (as scraped items) and more URLs to follow. The parse() method is in charge of processing the response and returning scraped data (as Item objects) and more URLs to follow (as Request objects). This

'parse_torrent')] def parse_torrent(self, response): x = HtmlXPathSelector(response) torrent = TorrentItem() torrent['url'] = response.url torrent['name'] = x.select("//h1/text()") called with the downloaded Response object of each start URL. The response is passed to the method as the first and only argument. This method is responsible for parsing the response data and extracting scraped data (as scraped items) and more URLs to follow. The parse() method is in charge of processing the response and returning scraped data (as Item objects) and more URLs to follow (as Request objects). This

r/\d+']), 'parse_torrent')] def parse_torrent(self, response): x = HtmlXPathSelector(response) torrent = TorrentItem() torrent['url'] = response.url torrent['name'] = x.select("//h1/text()").extract() called with the downloaded Response object of each start URL. The response is passed to the method as the first and only argument. This method is responsible for parsing the response data and extracting scraped data (as scraped items) and more URLs to follow. The parse() method is in charge of processing the response and returning scraped data (as Item objects) and more URLs to follow (as Request objects). This

start_urls = [ 'http://quotes.toscrape.com/tag/humor/', ] def parse(self, response): for quote in response.css('div.quote'): yield { 'text': quote.css('span.text::text') extract_first(), } next_page = response.css('li.next a::attr("href")').extract_first() if next_page is not None: yield response.follow(next_page, self.parse) Put this in the URL for quotes in humor category) and called the default callback method parse, passing the response object as an argument. In the parse callback, we loop through the quote elements using a CSS Selector

r/\d+']), 'parse_torrent')] def parse_torrent(self, response): x = HtmlXPathSelector(response) torrent = TorrentItem() torrent['url'] = response.url torrent['name'] = x.select("//h1/text()").extract() called with the downloaded Response object of each start URL. The response is passed to the method as the first and only argument. This method is responsible for parsing the response data and extracting scraped data (as scraped items) and more URLs to follow. The parse() method is in charge of processing the response and returning scraped data (as Item objects) and more URLs to follow (as Request objects). This

r/\d+']), 'parse_torrent')] def parse_torrent(self, response): x = HtmlXPathSelector(response) torrent = TorrentItem() torrent['url'] = response.url torrent['name'] = x.select("//h1/text()").extract() called with the downloaded Response object of each start URL. The response is passed to the method as the first and only argument. This method is responsible for parsing the response data and extracting scraped data (as scraped items) and more URLs to follow. The parse() method is in charge of processing the response and returning scraped data (as Item objects) and more URLs to follow (as Request objects). This

’/tor/\d+’]), ’parse_torrent’)] def parse_torrent(self, response): sel = Selector(response) torrent = TorrentItem() torrent[’url’] = response.url torrent[’name’] = sel.xpath("//h1/text()").extract() called with the downloaded Response object of each start URL. The response is passed to the method as the first and only argument. This method is responsible for parsing the response data and extracting scraped data (as scraped items) and more URLs to follow. The parse() method is in charge of processing the response and returning scraped data (as Item objects) and more URLs to follow (as Request objects). This