No handlers could be found for logger "mrjob.emr"
Traceback (most recent call last):
File "./loc_scr_gen.py", line 121, in <module>
main()
File "./loc_scr_gen.py", line 67, in main
runner.run()
File "/usr/lib/python2.6/site-packages/mrjob-0.4_dev-py2.6.egg/mrjob/runner.py", line 449, in run
self._run()
File "/usr/lib/python2.6/site-packages/mrjob-0.4_dev-py2.6.egg/mrjob/emr.py", line 840, in _run
self._wait_for_job_to_complete()
File "/usr/lib/python2.6/site-packages/mrjob-0.4_dev-py2.6.egg/mrjob/emr.py", line 1577, in _wait_for_job_to_complete
raise Exception(msg)
Exception: Job on job flow j-3370FHLVR5WCR failed with status SHUTTING_DOWN: Shut down as step failed
========
runners:
emr:
aws_access_key_id: XXXXX
aws_secret_access_key: XXXXX
aws_region: us-east-1
# ec2_instance_type: m1.xlarge
# num_ec2_instances: 4
s3_log_uri: s3://dsps-log/
s3_scratch_uri: s3://dsps-tmp/
base_tmp_dir: /data/emr_scratch
### setup cmds
bootstrap_cmds:
- sudo apt-get install -y python-pymongo
# - sudo pip install pymongo
### Setup python packasges ###
# bootstrap_python_packages:
# - s3://emr-pypackages/pymongo.2.4.2.tar.gz