Combine GET and POST Request on same page

19 views
Skip to first unread message

k bez

unread,
May 2, 2017, 1:26:11 PM5/2/17
to django-dynamic-scraper
I scrape only detailed pages with GET requests and works fine.
But i found a detailed page that need to use GET request for 2 elements and a FormRequest/POST for 1 element too.
After extensive testing i didnt find a way to combine both of them.
Is it possible with DDS and what setup it needs?
Thanks in advance

k bez

unread,
May 2, 2017, 7:21:49 PM5/2/17
to django-dynamic-scraper
OK after some more testing i found a way to combine GET and FormRequest/POST.
I have another problem now.
I need to provide dynamically form data
for example
{"pid" : "{temp_attr}"} where {temp_attr} is an attribute placeholder from another scrapped item.
But if i read right django_spider.py only with {page} placeholder we can do this and attribute placeholders isnt supporting there.
Is there another way to do this?

Reply all
Reply to author
Forward
0 new messages