using module s3 AttributeError: 'module' object has no attribute 's3'

584 views
Skip to first unread message

zik...@gmail.com

unread,
Oct 22, 2014, 9:51:57 AM10/22/14
to luigi...@googlegroups.com
Hi,

I am trying to use module s3, particularly S3FlagTarget and S3PathTask. But unfortunately I am getting AttributeError: 'module' object has no attribute 's3'.

I am using bleeding edge version of luigi cloned directly from github and when I go through code, then I can see that there is actually s3 file, so I don't understand this error. Does anybody has some idea what can possibly be wrong?

Thank you in advance for any help.

Best regards,
Jan

Complete error log:
WARNING: Will not schedule DataPreprocessing() or any dependencies due to error in complete() method:
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/luigi-1.0.19-py2.6.egg/luigi/worker.py", line 316, in _add
is_complete = self._check_complete(task)
File "/usr/lib/python2.6/site-packages/luigi-1.0.19-py2.6.egg/luigi/worker.py", line 310, in _check_complete
return task.complete()
File "/usr/lib/python2.6/site-packages/luigi-1.0.19-py2.6.egg/luigi/task.py", line 468, in complete
outputs = flatten(self.output())
File "luigi_driver.py", line 49, in output
luigi.s3.S3FlagTarget('my-data-bucket/tokens')

Joe Crobak

unread,
Oct 22, 2014, 10:35:25 AM10/22/14
to zik...@gmail.com, luigi...@googlegroups.com
I think you need to `import luigi.s3` based on the error you mentioned. If that's not it, could you post a small snippet to repro the problem?

Also, based on your stack trace, are you sure that you're using a version from master? Looks like the 1.0.19 egg is on your python path.


--
You received this message because you are subscribed to the Google Groups "Luigi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to luigi-user+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

zik...@gmail.com

unread,
Oct 22, 2014, 11:29:49 AM10/22/14
to luigi...@googlegroups.com, zik...@gmail.com
Thank you, importing luigi.s3 works for me.

And I think that I'm using version from master with some modification that I've implemented (hopefully I'll send PR soon). I assume that this added code would not work if I'd use luigi pip installation, but the 1.0.19 egg has also surprised me.
Reply all
Reply to author
Forward
Message has been deleted
0 new messages