Using dynamic models

[Nitay Rabinovich]

Hi,

Do you have any experience with implementing dynamic-models for scraping in order to override the need to define a new model for each data required?

The problem is the Scrapy item loader which creates issues without pre-defined Models. (KeyErrors)

Do you have any suggestions on the matter?

Thanks in advance, 

Nitay

[Holger Drewes]

Sorry, don't have an immediate suggestion on that, seems to be quite difficult to me the way DDS is designed.

Are you sure you have chosen the right technology stack, maybe plain scrapy or something else would be a better fit?

Holger

--
Sie erhalten diese Nachricht, weil Sie in Google Groups E-Mails von der Gruppe "django-dynamic-scraper" abonniert haben.
Wenn Sie sich von dieser Gruppe abmelden und keine E-Mails mehr von dieser Gruppe erhalten möchten, senden Sie eine E-Mail an django-dynamic-scraper+unsub...@googlegroups.com.
Weitere Optionen finden Sie unter https://groups.google.com/d/optout.

[Nitay Rabinovich]

Well, i really like what you did in DDS and found it as a good base for mapping Scrapy with Django admin. so i do think it's a good base that can always be extended :) 

בתאריך יום שלישי, 16 במאי 2017 בשעה 15:52:17 UTC+3, מאת Holger Drewes: