You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to scrapy-users
I have a strange problem and i could not find a solution for it. When i use scrapy crawl command for a single URL and i have process time about 1 sec. When i use scrapyd to process the same URL then I got 5 secs process time without HTTPCACHE_ENABLED and 3.5 secs with HTTPCACHE_ENABLED True( i saw same results both from console log and web UI runtime column). Keep in mind that i have (?) all relatives settings to lowest (DOWNLOAD_DELAY=0, poll_interval=0, concurrent high values, etc). Any idea why I have so strange process time?