hello scrapy users!
i'm working with scrapy + mongoDB...
i need to load images to mongoDB uisng pipelines (i mean full image not saving the path in the OS folder)
what i have is :
****spider***
item['file_urls']=response.xpath('//div[@id="imgTagWrapperId"]/img[@id="landingImage"]/@src').extract()
******items***
file_urls = scrapy.Field()
files = scrapy.Field()
****settings***
ITEM_PIPELINES = {
'scrapy.pipelines.images.FilesPipeline': 1,
'full.pipelines.MongoDBPipeline': 300,
}
FILES_STORE = '/home/Desktop/output'
thanks in advance,