yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")') if next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: quotes.jl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has not pleasure

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider quotes.jl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has ˓→not pleasure

yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")') if next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: quotes.jl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has not pleasure

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider quotes.jl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has␣ ˓→not pleasure

quote in response.css("div.quote"): yield { "author": quote.xpath("span/small/text()").get(), "text": quote.css("span.text::text").get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider quotes.jsonl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has␣ ˓→not pleasure

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider quotes.jl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has␣ ˓→not pleasure

quote in response.css("div.quote"): yield { "author": quote.xpath("span/small/text()").get(), "text": quote.css("span.text::text").get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider quotes.jsonl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has␣ ˓→not pleasure

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider quotes.jsonl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has␣ ˓→not pleasure

yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")') if next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: quotes.jsonl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has not pleasure

yield { "author": quote.xpath("span/small/text()").get(), "text": quote.css("span.text::text").get(), } next_page = response.css('li.next a::attr("href")') if next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: quotes.jsonl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has not pleasure