Configuring EMR managed security groups

[Ariel Camperi]

Hello,

I'm trying to configure EMR clusters launched with mrjob with custom EMR-managed security groups (that is, pre-existing customized master/slave security groups that EMR then adds its managed rules to). As far as I can tell, there used to be an `emr_api_params` mrjob option that might have been a good workaround here, but that was removed as of v0.7.0 (for what it's worth I'm currently on v0.6.6 but I'd rather not start depending on something that's actually removed a couple versions forward). I can't find any mrjob support for the `--ec2-attributes` cluster creation param that this would be under if calling AWS directly, and `emr_configurations` isn't the right place as far as I can tell. Does anyone have any advice for how to proceed? Also FWIW I'm aware that I can just have EMR automatically create its managed security groups and then manually edit them after the fact with whatever custom rules I want, but I'm trying to avoid that since I can automate the pre-creation with Terraform.

Thanks so much,

Ariel

[Dave Marin]

Try extra_cluster_params, which replaced emr_api_params because of the shift from boto 2 to boto3.

See https://mrjob.readthedocs.io/en/latest/guides/cloud-opts.html for more info.

-Dave

> --
> You received this message because you are subscribed to the Google Groups "mrjob" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to mrjob+un...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/mrjob/f5607478-68c6-4d8b-9a65-0a7962a20327%40googlegroups.com.

[Ariel Camperi]

Ah perfect, that looks like exactly what I need :) Thanks!

You received this message because you are subscribed to a topic in the Google Groups "mrjob" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/mrjob/9Lnvl7sVQyA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to mrjob+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mrjob/BB4E5994-B19F-4C2F-B56C-9E78D8128B1C%40davemarin.com.