basic issue

15 views
Skip to first unread message

JRD

unread,
May 30, 2013, 10:20:56 AM5/30/13
to scrap...@googlegroups.com
Hi - have just got started with ScraperWiki and for my first project have made a basic headline to full text RSS scraper for the BBC.

JRD / BBC_HEADLINE_RSS_2FULL


All seems to work - up until I get to writing to the datastore - then I get an error message, which I have so far had no luck trying to dicipher:

SqliteError: dataproxy.process: [Errno 31] Too many links: '/var/www/scraperwiki/resourcedir/bbc_headline_rss_2full'; stacktrace:Traceback (most recent call last): File "/var/www/scraperwiki/uml/dataproxy/dataproxy.py", line 105, in process res = db.

the 'probable' culprit from my code:
=============================================
data
= {'title' : title,
           'description' : story,
           'link' : link,
           'pubDate': date
}
    
scraperwiki.sqlite.save(unique_keys=['description'], data=data)
=============================================

Please could anyone give me some clues as to where I am going wrong.

cheers

Zarino Zappia

unread,
May 30, 2013, 10:28:09 AM5/30/13
to scrap...@googlegroups.com
Hi there.

Thanks for the bug report. We think we know what's going on. We'll look into it this afternoon and get back to you.

Zarino Zappia
VP of Product, ScraperWiki
@zarino



--
You received this message because you are subscribed to the Google Groups "ScraperWiki" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scraperwiki...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

Zarino Zappia

unread,
May 30, 2013, 1:08:46 PM5/30/13
to scrap...@googlegroups.com
This should be fixed now.

Z

Jon Dowson

unread,
May 30, 2013, 2:17:50 PM5/30/13
to scrap...@googlegroups.com
Thanks Zarino for sorting that out - works fine now.

Jon


--
You received this message because you are subscribed to a topic in the Google Groups "ScraperWiki" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/scraperwiki/LIlfk-UyFcE/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to scraperwiki...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages