mrjob v0.6.4 is out!
5 views
Skip to first unread message
Dave Marin
Aug 11, 2018, 12:58:06 AM8/11/18
to mr...@googlegroups.com
mrjob v0.6.4 is up on PyPI.
This release adds the DIRS attribute to MRJobs, which allows you to specify the relative paths of one or more directories, which will automatically be uploaded to your job’s working directory. This means you can upload your entire Python source tree if you like, and, in most typical cases, makes setup scripts unecessary. There are also FILES and ARCHIVES attributes and corresponding methods, if you need them.
This release already fixes a bug in terminate-idle-clusters that caused it to crash on termination-protected clusters.
This release also officially drops support for Python 3.3 (which has reached end of life), and explicitly requires google-cloud-dataproc 0.2.0 rather than vendoring a development version of it.
For more details, start at http://mrjob.readthedocs.io/en/stable/whats-new.html#v0-6-4
Enjoy!
-Dave
This release adds the DIRS attribute to MRJobs, which allows you to specify the relative paths of one or more directories, which will automatically be uploaded to your job’s working directory. This means you can upload your entire Python source tree if you like, and, in most typical cases, makes setup scripts unecessary. There are also FILES and ARCHIVES attributes and corresponding methods, if you need them.
This release already fixes a bug in terminate-idle-clusters that caused it to crash on termination-protected clusters.
This release also officially drops support for Python 3.3 (which has reached end of life), and explicitly requires google-cloud-dataproc 0.2.0 rather than vendoring a development version of it.
For more details, start at http://mrjob.readthedocs.io/en/stable/whats-new.html#v0-6-4
Enjoy!
-Dave
Reply all
Reply to author
Forward
0 new messages