django-dynamic-scraper

Hi, sure I'm still using this On Tue, Feb 14, 2023 at 11:06 AM Jimi <ji...@odyssey.dog>

I have a scrapy project. I would like to integrate with simple django app. But I don't know well

It's a bug in django-dynamic-scraper. On Wednesday, September 25, 2019 at 10:57:00 AM UTC-4,

That's because that element is set to mandatory and the xpath you have provided is returning null

I have a query about the migrations of the database, also that the sample sites do the scraping but

This is nothing library-specific but a Django feature, read a bit in the Django (probably rather for

Hi Rakan, I know this was posted a long time ago, but I am in real need of help, I have a xpath which

Hey, What is the best way to reach you. Your package has my interest On Saturday, June 3, 2017 at 8:

Hello, I think this is an interesting tool. I will like to pay someone $30 to setup up a package that

I have attached the screenshot of that error. Help me with this error

I want to scrape a site with this structure: main page -> categories page (6 categories) ->

hello, can you send a document of DDS for me? thank you!

Well, i really like what you did in DDS and found it as a good base for mapping Scrapy with Django

Hi everyone, DDS v.0.12.0 is out with a completely overhauled command line output, command line help

On Friday, May 5, 2017 at 5:55:42 PM UTC+7, Holger Drewes wrote: Hmm, no, it will start from the

I already solved it by searching the url in the database (I override the save method in DjangoItem).

I see, I miss that part when I read the document. Thank you for your explanation Holger. On Friday,

Holger i have same problem cause attrib placeholders are supporting inside form data. Is it possible

OK after some more testing i found a way to combine GET and FormRequest/POST. I have another problem

I just use django with a little web project, no experience with scrapy.

You either have to add the dynamic_scraper directory to your phyton path or alternatively you can (

The problem was that I added http pre_url while wikinews uses https. Thank you anyway. El martes, 29

Hi Holger, Thanks, it is working! Below my ATTR_TYPE and minor adjustment of SCRAPERS. General

https://github.com/holgerd77/django-dynamic-scraper/issues/80

Hey, i want to save the whole child nodes as text (or the html structure) to a field of a django

Hey, I run into an exception after a second crawl run, when items should get updated. Somehow '

First of all,Thanks for author sharing this resource.It's helpful. I Meet a question like that:

I have now integrated an official way to add new custom processors in DDS v.0.11.1 release, see

Yeah! I just was a little embarrassed about it. Turned out I had the mandatory checkbox checked for

I have an error when i run example: [root] ERROR: Mandatory elem title missing! i don't know what