. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 5 Solving specific problems 83 5.1 Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . concepts Scrapy Documentation, Release 0.22.0 Note: Those familiar with Django will notice that Scrapy Items are declared similar to Django Models, except that Scrapy Items are much simpler as there is no concept crawler using a web service. 82 Chapter 4. Built-in services CHAPTER 5 Solving specific problems 5.1 Frequently Asked Questions 5.1.1 How does Scrapy compare to BeautifulSoup or lxml? BeautifulSoup

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 5 Solving specific problems 81 5.1 Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . concepts Scrapy Documentation, Release 0.20.2 Note: Those familiar with Django will notice that Scrapy Items are declared similar to Django Models, except that Scrapy Items are much simpler as there is no concept crawler using a web service. 80 Chapter 4. Built-in services CHAPTER 5 Solving specific problems 5.1 Frequently Asked Questions 5.1.1 How does Scrapy compare to BeautifulSoup or lxml? BeautifulSoup

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71 5 Solving specific problems 79 5.1 Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Field(default=0) last_updated = Field() Note: Those familiar with Django will notice that Scrapy Items are declared similar to Django Models, except that Scrapy Items are much simpler as there is no concept Documentation, Release 0.12.0 78 Chapter 4. Built-in services CHAPTER 5 Solving specific problems 5.1 Frequently Asked Questions 5.1.1 How does Scrapy compare to BeautifulSoul or lxml? BeautifulSoup

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72 5 Solving specific problems 79 5.1 Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Field() last_updated = Field(serializer=str) Note: Those familiar with Django will notice that Scrapy Items are declared similar to Django Models, except that Scrapy Items are much simpler as there is no concept crawler using a web service. 78 Chapter 4. Built-in services CHAPTER 5 Solving specific problems 5.1 Frequently Asked Questions 5.1.1 How does Scrapy compare to BeautifulSoup or lxml? BeautifulSoup

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72 5 Solving specific problems 79 5.1 Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . concepts Scrapy Documentation, Release 0.18.4 Note: Those familiar with Django will notice that Scrapy Items are declared similar to Django Models, except that Scrapy Items are much simpler as there is no concept crawler using a web service. 78 Chapter 4. Built-in services CHAPTER 5 Solving specific problems 5.1 Frequently Asked Questions 5.1.1 How does Scrapy compare to BeautifulSoup or lxml? BeautifulSoup

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80 5 Solving specific problems 87 5.1 Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . last_updated = scrapy.Field(serializer=str) Note: Those familiar with Django will notice that Scrapy Items are declared similar to Django Models, except that Scrapy Items are much simpler as there is no concept crawler using a web service. 86 Chapter 4. Built-in services CHAPTER 5 Solving specific problems 5.1 Frequently Asked Questions 5.1.1 How does Scrapy compare to BeautifulSoup or lxml? BeautifulSoup

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 5 Solving specific problems 77 5.1 Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Field() last_updated = Field(serializer=str) Note: Those familiar with Django will notice that Scrapy Items are declared similar to Django Models, except that Scrapy Items are much simpler as there is no concept crawler using a web service. 76 Chapter 4. Built-in services CHAPTER 5 Solving specific problems 5.1 Frequently Asked Questions 5.1.1 How does Scrapy compare to BeautifulSoup or lxml? BeautifulSoup

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 5 Solving specific problems 69 5.1 Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Field(default=0) last_updated = Field() Note: Those familiar with Django will notice that Scrapy Items are declared similar to Django Models, except that Scrapy Items are much simpler as there is no concept Documentation, Release 0.9 68 Chapter 4. Built-in services CHAPTER 5 Solving specific problems 5.1 Frequently Asked Questions 5.1.1 How does Scrapy compare to BeautifulSoul or lxml? BeautifulSoup

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124 5 Solving specific problems 127 5.1 Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 Scrapy Documentation, Release 1.2.3 Note: Those familiar with Django will notice that Scrapy Items are declared similar to Django Models, except that Scrapy Items are much simpler as there is no concept Python code. In other words, comparing BeautifulSoup (or lxml) to Scrapy is like comparing jinja2 to Django. Can I use Scrapy with BeautifulSoup? Yes, you can. As mentioned above, BeautifulSoup can be used

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118 5 Solving specific problems 121 5.1 Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . last_updated = scrapy.Field(serializer=str) Note: Those familiar with Django will notice that Scrapy Items are declared similar to Django Models, except that Scrapy Items are much simpler as there is no concept Python code. In other words, comparing BeautifulSoup (or lxml) to Scrapy is like comparing jinja2 to Django. Can I use Scrapy with BeautifulSoup? Yes, you can. As mentioned above, BeautifulSoup can be used