ImportError: No module named pyparsing

[Roy]

Hi,

    I am new to luigi and recently started trying my hands on luigi.

We have luigid running on Host1, now I want to able to submit task from Host2 to luigi server running on Host1.

I did following to make it run,

1. git clone https://github.com/spotify/luigi.git

2. ran python setup.py install

3. created /etc/luigi/client.cfg with following config :

[core]

default-scheduler-host: host1

4. ran python examples/top_artists.py AggregateArtists --local-scheduler --date-interval 2012-06

    but got following error

 

Traceback (most recent call last):

  File "examples/top_artists.py", line 2, in <module>

    import luigi, luigi.hdfs, luigi.hadoop

  File "/usr/lib/python2.6/site-packages/luigi-1.0.19-py2.6.egg/luigi/__init__.py", line 16, in <module>

    import task

  File "/usr/lib/python2.6/site-packages/luigi-1.0.19-py2.6.egg/luigi/task.py", line 20, in <module>

    import pyparsing as pp

ImportError: No module named pyparsing

i have al dependency packages (docopt (0.6.2), luigi (1.0.19), pyparsing (2.0.3) & tornado (2.2.1))

Anyone can help with this ?

Thanks

[Roy]

Got it working.

pyparsing was missing in python 2.6

[yashwanth rao]

I have the same problem. I am running luigi on a hadoop edge-node. The edge-node has python-2.7, where as the data-nodes in the cluster has python2.6. So should i install pyparsing on all the datanodes? Or will luigi copy the dependencies to the cluster during runtime.

Thanks,

Yashwanth

[Erik Bernhardsson]

You can do either way, either install pyparsing on all nodes, or make sure to do luigi.hadoop.attach(pyparsing) at the top of your script (haven't tried it though).

I'm also going to move the pyparsing stuff away from luigi.task, because it's a deprecated function and clutters luigi.task. I'll move it to luigi.util instead (and add a redirect)

--
You received this message because you are subscribed to the Google Groups "Luigi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to luigi-user+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Erik Bernhardsson

Engineering Manager, Spotify, New York