Re: ImportError: No module named boto.s3.connection

[Steve Johnson]

Yeah, you need to install boto as part of your bootstrapping. `bootstrap: ["sudo pip install boto"]` should do it.

 

 

On Sun, Jan 19, 2014, at 01:13 AM, al so wrote:

I get this "ImportError: No module named boto.s3.connection" when trying to run in EMR.

 

code snippet:

 

from boto.s3.connection import S3Connection

from mrjob.protocol import PickleProtocol

from mrjob.job import MRJob

 

class tt(MRJob):

    conn = S3Connection('key','secret')

    bk = conn.get_bucket('my_bkt')

    ...

 

 

I run the above code like: 

python abovecode.py -r emr --output-dir=s3://B1/OUT_DIR/ --no-output s3://B1/input/

 

Nothing special in mrjob.conf. 

 

stack trace snippet:

File "abovecode.py", line 1, in <module>

    from boto.s3.connection import S3Connection

ImportError: No module named boto.s3.connection

 

 

 

Everything works when run in local mode. But fails with above error in EMR mode.

Looks like I need to somehow make the code download boto into EMR?

 

Apologies in case I didn't give full context.

 

--

You received this message because you are subscribed to the Google Groups "mrjob" group.

To unsubscribe from this group and stop receiving emails from it, send an email to mrjob+un...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.