sarwarul
unread,Jul 12, 2011, 3:10:34 PM7/12/11Sign in to reply to author
Sign in to forward
You do not have permission to delete messages in this group
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to pycassa-devel
I am using (Pycassa+thrift0.6+cassandr0.8.0+scrapy) to parse the date
from different websites and through it directly to Cassandra. I can
import pycassa module from python(2.6) shell and code is running fine.
However, when I want to run the script from Ubuntu 10.04 terminal
getting the following error. It seems to me that problem is with
defining thrift classpath. Any suggestions? Thrift installed at /usr/
lib/python2.6/site-packages/thrift. I do not want to switch the
database.
Traceback (most recent call last):
File "/usr/bin/scrapy", line 4, in <module>
execute()
File "/usr/lib/pymodules/python2.6/scrapy/cmdline.py", line 131, in
execute
_run_print_help(parser, _run_command, cmd, args, opts)
File "/usr/lib/pymodules/python2.6/scrapy/cmdline.py", line 97, in
_run_print_help
func(*a, **kw)
File "/usr/lib/pymodules/python2.6/scrapy/cmdline.py", line 138, in
_run_command
cmd.run(args, opts)
File "/usr/lib/pymodules/python2.6/scrapy/commands/crawl.py", line
41, in run
q = self.crawler.queue
File "/usr/lib/pymodules/python2.6/scrapy/command.py", line 33, in
crawler
self._crawler.configure()
File "/usr/lib/pymodules/python2.6/scrapy/crawler.py", line 43, in
configure
self.engine = ExecutionEngine(self.settings, self._spider_closed)
File "/usr/lib/pymodules/python2.6/scrapy/core/engine.py", line 33,
in __init__
self.scraper = Scraper(self, self.settings)
File "/usr/lib/pymodules/python2.6/scrapy/core/scraper.py", line 66,
in __init__
self.itemproc = itemproc_cls.from_settings(settings)
File "/usr/lib/pymodules/python2.6/scrapy/middleware.py", line 29,
in from_settings
mwcls = load_object(clspath)
File "/usr/lib/pymodules/python2.6/scrapy/utils/misc.py", line 39,
in load_object
raise ImportError, "Error loading object '%s': %s" % (path, e)
ImportError: Error loading object 'test.pipelines.testPipeline': No
module named thrift