ERROR: Unknown feed storage scheme: d

[Lover103]

run the loca, the log:

2013-07-04 20:55:47+0800 [scrapy] INFO: Scrapy 0.16.4 started (bot: scrapybot)

2013-07-04 20:55:47+0800 [scrapy] DEBUG: Enabled extensions: LogStats, TelnetConsole, CloseSpider, WebService, CoreStats, SpiderState

2013-07-04 20:55:48+0800 [scrapy] DEBUG: Enabled downloader middlewares: HttpAuthMiddleware, DownloadTimeoutMiddleware, RotateUserAgentMiddleware, RetryMiddleware, DefaultHeadersMiddleware, RedirectMiddleware, HttpCompressionMiddleware, ChunkedTransferMiddleware, DownloaderStats

2013-07-04 20:55:48+0800 [scrapy] DEBUG: Enabled spider middlewares: HttpErrorMiddleware, OffsiteMiddleware, RefererMiddleware, UrlLengthMiddleware, DepthMiddleware

2013-07-04 20:55:48+0800 [scrapy] DEBUG: Enabled item pipelines: WoaiduCoverImage, SQLStorePipeline, woaiduSQLStorePipeline

2013-07-04 20:55:48+0800 [woaidu] INFO: Spider opened

2013-07-04 20:55:48+0800 [woaidu] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)

2013-07-04 20:55:48+0800 [scrapy] DEBUG: Telnet console listening on 0.0.0.0:6023

2013-07-04 20:55:48+0800 [scrapy] DEBUG: Web service listening on 0.0.0.0:6080

But run the scrapyd, the log:

2013-07-04 20:38:26+0800 [scrapy] INFO: Scrapy 0.16.4 started (bot: scrapybot)

2013-07-04 20:38:26+0800 [scrapy] ERROR: Unknown feed storage scheme: d

2013-07-04 20:38:26+0800 [scrapy] DEBUG: Enabled extensions: LogStats, TelnetConsole, CloseSpider, WebService, CoreStats, SpiderState

2013-07-04 20:38:26+0800 [scrapy] DEBUG: Enabled downloader middlewares: HttpAuthMiddleware, DownloadTimeoutMiddleware, RotateUserAgentMiddleware, RetryMiddleware, DefaultHeadersMiddleware, RedirectMiddleware, HttpCompressionMiddleware, ChunkedTransferMiddleware, DownloaderStats

2013-07-04 20:38:26+0800 [scrapy] DEBUG: Enabled spider middlewares: HttpErrorMiddleware, OffsiteMiddleware, RefererMiddleware, UrlLengthMiddleware, DepthMiddleware

2013-07-04 20:38:26+0800 [scrapy] DEBUG: Enabled item pipelines: SQLStorePipeline

what fix it? please help me!

[Paul Tremberth]

What are your settings for your pipelines?

This error seems to come from _storage_supported

https://github.com/scrapy/scrapy/blob/master/scrapy/contrib/feedexport.py

which is called with what's in FEED_URI

def __init__(self, settings):
        self.settings = settings
        self.urifmt = settings['FEED_URI']
        if not self.urifmt:
            raise NotConfigured
        self.format = settings['FEED_FORMAT'].lower()
        self.storages = self._load_components('FEED_STORAGES')
        self.exporters = self._load_components('FEED_EXPORTERS')
        if not self._storage_supported(self.urifmt):

See http://doc.scrapy.org/en/latest/topics/feed-exports.html#std:setting-FEED_URI

&

http://doc.scrapy.org/en/latest/topics/feed-exports.html#topics-feed-storage-backends

[Lover103]

This is my settings for pipelines:

ITEM_PIPELINES = [

    'dirbot.pipelines.cover_image.WoaiduCoverImage',

    'dirbot.pipelines.mysqldb.SQLStorePipeline',

    'dirbot.pipelines.mysqldb.woaiduSQLStorePipeline',

]

在 2013年7月4日星期四UTC+8下午9时22分27秒，Paul Tremberth写道：

[Dimitris]

Just for reference. The bug here is on scrapyd code and when you
run on Windows, it creates
automatically a file with the format C://whatever or d:// whatever.
So that "C" or "D" at the beginning
is interpreted as protocol (instead of e.g. file://) and this is the error
you see here. To fix (quick and
dirty) just add

FEED_STORAGES={'c': 'scrapy.contrib.feedexport.FileFeedStorage'}

where c or d or whatever is the letter on the error
message on your settings.py file.