Hi - have just got started with ScraperWiki and for my first project have made a basic headline to full text RSS scraper for the BBC.
JRD /
BBC_HEADLINE_RSS_2FULL
All seems to work - up until I get to writing to the datastore - then I get an error message, which I have so far had no luck trying to dicipher:
SqliteError: dataproxy.process: [Errno
31] Too many links:
'/var/www/scraperwiki/resourcedir/bbc_headline_rss_2full';
stacktrace:Traceback (most recent call last):
File "/var/www/scraperwiki/uml/dataproxy/dataproxy.py", line 105, in
process
res = db. the 'probable' culprit from my code:
=============================================
data = {'title' : title, 'description' : story, 'link' : link, 'pubDate': date} scraperwiki.sqlite.save(unique_keys=['description'], data=data)=============================================
Please could anyone give me some clues as to where I am going wrong.
cheers