Is there a extract() method like in scrapy?

14 views
Skip to first unread message

Matthias Brück

unread,
Oct 19, 2016, 6:00:18 PM10/19/16
to django-dynamic-scraper
Hey,

i want to save the whole child nodes as text (or the html structure) to a field of a django object. Something like:

response.selector.xpath('//span/text()').extract()

Somehow the xpath query and processors are limiting if the html structure is quite complex or needs a lot of postprocessing. Should i then stop using the dynamic scraper and do it with scrapy directly?

Thank you!

Best,
Matthias
Reply all
Reply to author
Forward
0 new messages