how to insert data in mysql from scrapy

80 views
Skip to first unread message

Anurag Sharma

unread,
Dec 5, 2014, 8:53:06 AM12/5/14
to scrapy...@googlegroups.com
i have attached my all code
i am not able to insert data from scrapy to mysql
after attached code i am running following command

scrapy crawl amazon

please help me
how can we insert

thansk
items.py
__init__.py
pipelines.py

Danilo Oliveira

unread,
Dec 16, 2014, 3:47:19 PM12/16/14
to scrapy...@googlegroups.com
simple google request bring it to us:

Anish Pradhan

unread,
Dec 27, 2014, 10:02:08 AM12/27/14
to scrapy...@googlegroups.com
I had same problem and I solved the problem with pipeline. I used mysqldb to insert the data directly to mysql. 

Anurag Sharma

unread,
Jan 14, 2015, 5:44:56 AM1/14/15
to scrapy...@googlegroups.com
thanks for reply 
i tried with pipeline it 's done
i need without pipeline 
i am trying without pipeline but it saved last record in DB 

is there any way to define pipeline belongs to specific spider

thanks

--
You received this message because you are subscribed to a topic in the Google Groups "scrapy-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/scrapy-users/KmWOp4Vns-k/unsubscribe.
To unsubscribe from this group and all its topics, send an email to scrapy-users...@googlegroups.com.
To post to this group, send email to scrapy...@googlegroups.com.
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.



--
Thanks
anurag sharma

Reply all
Reply to author
Forward
0 new messages