Cancelling scheduled spider in scrapy

23 views
Skip to first unread message

vanam raghu

unread,
Jan 16, 2017, 1:02:55 AM1/16/17
to scrapy-users
I have scheduled spider which is running, while its running when i run the command

 curl http://localhost:6800/cancel.json -d project=tivoscraper -d job=fc6612fcdbab11e6a5fad8cb8a8ed5e8

It shows {"status": "ok", "prevstate": "running", "node_name": ""}

but when i check in the GUI, i am still seeing spider under running state and run time is getting updated, opening the log file shows


2017-01-16 11:24:56 [scrapy] INFO: Closing spider (shutdown)
2017-01-16 11:24:56 [scrapy] INFO: Crawled 20 pages (at 3 pages/min), scraped 18 items (at 3 items/min)

I think its not cancelled the job, is there any better way of shutting down the running spider??
Reply all
Reply to author
Forward
0 new messages