Groups
Groups
Sign in
Groups
Groups
django-dynamic-scraper
Conversations
About
Send feedback
Help
Is there a extract() method like in scrapy?
15 views
Skip to first unread message
Matthias Brück
unread,
Oct 19, 2016, 6:00:18 PM
10/19/16
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to django-dynamic-scraper
Hey,
i want to save the whole child nodes as text (or the html structure) to a field of a django object. Something like:
response
.
selector
.
xpath
(
'//span/text()'
)
.
extract
()
Somehow the xpath query and processors are limiting if the html structure is quite complex or needs a lot of postprocessing. Should i then stop using the dynamic scraper and do it with scrapy directly?
Thank you!
Best,
Matthias
Reply all
Reply to author
Forward
0 new messages