Accordingly the type of the request in the log is html. The other requests have types like css or js, but what interests us is the one request called quotes?page=1 with the type json. If we click on css("script::text").get() >>> data = chompjs.parse_js_object(javascript) >>> data {'field': 'value', 'secondField': 'second value'} • Otherwise, use js2xml to convert the JavaScript code into an XML document JavaScript code contains var data = {field: "value"}; you can extract that data as follows: >>> import js2xml >>> import lxml.etree >>> from parsel import Selector (continues on next page) 204 Chapter 5

Accordingly the type of the request in the log is html. The other requests have types like css or js, but what interests us is the one request called quotes?page=1 with the type json. If we click on css("script::text").get() >>> data = chompjs.parse_js_object(javascript) >>> data {'field': 'value', 'secondField': 'second value'} • Otherwise, use js2xml to convert the JavaScript code into an XML document JavaScript code contains var data = {field: "value"}; you can extract that data as follows: >>> import js2xml >>> import lxml.etree >>> from parsel import Selector (continues on next page) 202 Chapter 5

Accordingly the type of the request in the log is html. The other requests have types like css or js, but what interests us is the one request called quotes?page=1 with the type json. If we click on get() >>> data = chompjs.parse_js_object(javascript) >>> data {'field': 'value', 'secondField': 'second value'} Otherwise, use js2xml [https://github.com/scrapinghub/js2xml] to convert the JavaScript data as follows: >>> import js2xml >>> import lxml.etree >>> from parsel import Selector >>> javascript = response.css('script::text').get() >>> xml = lxml.etree.tostring(js2xml.parse(javascript), encoding='unicode')

Accordingly the type of the request in the log is html. The other requests have types like css or js, but what interests us is the one request called quotes?page=1 with the type json. If we click on get() >>> data = chompjs.parse_js_object(javascript) >>> data {'field': 'value', 'secondField': 'second value'} Otherwise, use js2xml [https://github.com/scrapinghub/js2xml] to convert the JavaScript data as follows: >>> import js2xml >>> import lxml.etree >>> from parsel import Selector >>> javascript = response.css('script::text').get() >>> xml = lxml.etree.tostring(js2xml.parse(javascript), encoding='unicode')

Accordingly the type of the request in the log is html. The other requests have types like css or js, but what interests us is the one request called quotes?page=1 with the type json. If we click on get() >>> data = chompjs.parse_js_object(javascript) >>> data {'field': 'value', 'secondField': 'second value'} Otherwise, use js2xml [https://github.com/scrapinghub/js2xml] to convert the JavaScript data as follows: >>> import js2xml >>> import lxml.etree >>> from parsel import Selector >>> javascript = response.css('script::text').get() >>> xml = lxml.etree.tostring(js2xml.parse(javascript), encoding='unicode')

Accordingly the type of the request in the log is html. The other requests have types like css or js, but what interests us is the one request called quotes?page=1 with the type json. If we click on get() >>> data = chompjs.parse_js_object(javascript) >>> data {'field': 'value', 'secondField': 'second value'} Otherwise, use js2xml [https://github.com/scrapinghub/js2xml] to convert the JavaScript data as follows: >>> import js2xml >>> import lxml.etree >>> from parsel import Selector >>> javascript = response.css("script::text").get() >>> xml = lxml.etree.tostring(js2xml.parse(javascript), encoding="unicode")

Accordingly the type of the request in the log is html. The other requests have types like css or js, but what interests us is the one request called quotes?page=1 with the type json. If we click on get() >>> data = chompjs.parse_js_object(javascript) >>> data {'field': 'value', 'secondField': 'second value'} Otherwise, use js2xml [https://github.com/scrapinghub/js2xml] to convert the JavaScript data as follows: >>> import js2xml >>> import lxml.etree >>> from parsel import Selector >>> javascript = response.css("script::text").get() >>> xml = lxml.etree.tostring(js2xml.parse(javascript), encoding="unicode")

Accordingly the type of the request in the log is html. The other requests have types like css or js, but what interests us is the one request called quotes?page=1 with the type json. If we click on get() >>> data = chompjs.parse_js_object(javascript) >>> data {'field': 'value', 'secondField': 'second value'} Otherwise, use js2xml [https://github.com/scrapinghub/js2xml] to convert the JavaScript data as follows: >>> import js2xml >>> import lxml.etree >>> from parsel import Selector >>> javascript = response.css("script::text").get() >>> xml = lxml.etree.tostring(js2xml.parse(javascript), encoding="unicode")

Accordingly the type of the request in the log is html. The other requests have types like css or js, but what interests us is the one request called quotes?page=1 with the type json. If we click on get() >>> data = chompjs.parse_js_object(javascript) >>> data {'field': 'value', 'secondField': 'second value'} Otherwise, use js2xml [https://github.com/scrapinghub/js2xml] to convert the JavaScript data as follows: >>> import js2xml >>> import lxml.etree >>> from parsel import Selector >>> javascript = response.css("script::text").get() >>> xml = lxml.etree.tostring(js2xml.parse(javascript), encoding="unicode")

Accordingly the type of the request in the log is html. The other requests have types like css or js, but what interests us is the one request called quotes?page=1 with the type json. If we click on re_first(pattern) >>> json.loads(json_data) {'field': 'value'} Otherwise, use js2xml [https://github.com/scrapinghub/js2xml] to convert the JavaScript code into an XML document that you can parse using data as follows: >>> import js2xml >>> import lxml.etree >>> from parsel import Selector >>> javascript = response.css('script::text').get() >>> xml = lxml.etree.tostring(js2xml.parse(javascript), encoding='unicode')