Airflow 1.10.2 and DAG Level Access Control

[Amir Amangeldi]

Hi all,

I am wondering if there are any plans to make Airflow 1.10.2 (DAG Level Access Control in particular) available in Cloud Composer any time soon?

Thanks!

Amir Amangeldi

EVERQUOTE  | Software Engineer

[Amir Amangeldi]

Just wanted to bring up this question again. Is there an estimate for when Airflow 1.10.2 will be supported?

Thanks!

Amir

EVERQUOTE  | Software Engineer

[binamenator K.]

Hi,

I'd like this too. I would really appreciate proper permissions setup so other people don't mess with my dags on accident.

Binam

(edited 3 times because I can't use grammar apparently)

On Friday, January 25, 2019 at 12:40:37 PM UTC-5, Amir Amangeldi wrote:

[Conrad Lee]

Bump.  I've been waiting around for 1.10.2 too -- any update on when this will come out?

If there's a delay that's fine but it's good to know about.  This kind of update lets met decide whether to implement things as custom plugins or wait around until the next release where they're included.

--
You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-di...@googlegroups.com.
To post to this group, send email to cloud-compo...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/6d0fb71d-6a44-442b-9d07-1e13bf541bae%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Feng Lu]

Hi Amir/Binam/Conrad, 

1.10.2 will be released in a few weeks (ETA: early May). 

RBAC in Airflow webUI will not be supported as it doesn't provide true DAG-level isolation, for example, one malicious DAG can still read/modify/delete metadata owned by other DAGs. We are working on an alternative form of multi-tenancy support inside Composer, if you have a GCP contact for your org, please ask that person to set up a meeting with us. Happy to share more details there. 

Thanks.

Feng 

To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/CALsf9RP89Wa9w7t0q7uUMM0fk5Wwg2wVyO1h7P428v%3DibYDLyw%40mail.gmail.com.

[André Fernandes]

It would also be nice to have 1.10.2 support given that previous 1.10 versions has a scheduler that loves your CPUs:

https://stackoverflow.com/questions/42419834/airbnb-airflow-using-all-system-resources

[Feng Lu]

Yep, we just released the support for Airflow 1.10.2 last week and the rollout is expected to reach all regions by May 22. 

On Mon, May 13, 2019 at 7:25 AM André Fernandes <a.fer...@faceit.com> wrote:

It would also be nice to have 1.10.2 support given that previous 1.10 versions has a scheduler that loves your CPUs:

https://stackoverflow.com/questions/42419834/airbnb-airflow-using-all-system-resources

--
You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-di...@googlegroups.com.
To post to this group, send email to cloud-compo...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/1117ee61-1b52-4735-af1b-9b41122edab0%40googlegroups.com.

[Rick Otten]

Ok, so according to the dashboard, I'm running "composer-1.3.0-airflow-1.10.0".

How do I get to "composer-1.7.0-airflow-1.10.2"?

On Monday, May 20, 2019 at 2:18:10 AM UTC-4, Feng Lu wrote:

Yep, we just released the support for Airflow 1.10.2 last week and the rollout is expected to reach all regions by May 22. 

On Mon, May 13, 2019 at 7:25 AM André Fernandes <a.fer...@faceit.com> wrote:

It would also be nice to have 1.10.2 support given that previous 1.10 versions has a scheduler that loves your CPUs:

https://stackoverflow.com/questions/42419834/airbnb-airflow-using-all-system-resources

--
You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-discuss+unsub...@googlegroups.com.

[Wilson Lian]

Hi Rick,

You can follow these instructions to upgrade your environment: https://cloud.google.com/composer/docs/how-to/managing/upgrading

Best,

Wilson

On Tue, May 21, 2019, 11:14 Rick Otten <ri...@safechain.io> wrote:

Ok, so according to the dashboard, I'm running "composer-1.3.0-airflow-1.10.0".

How do I get to "composer-1.7.0-airflow-1.10.2"?

On Monday, May 20, 2019 at 2:18:10 AM UTC-4, Feng Lu wrote:

Yep, we just released the support for Airflow 1.10.2 last week and the rollout is expected to reach all regions by May 22. 

On Mon, May 13, 2019 at 7:25 AM André Fernandes <a.fer...@faceit.com> wrote:

It would also be nice to have 1.10.2 support given that previous 1.10 versions has a scheduler that loves your CPUs:

https://stackoverflow.com/questions/42419834/airbnb-airflow-using-all-system-resources

--
You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-di...@googlegroups.com.

To post to this group, send email to cloud-compo...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/1117ee61-1b52-4735-af1b-9b41122edab0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-di...@googlegroups.com.

To post to this group, send email to cloud-compo...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/cb060a71-1d32-4d55-8cf0-ef0193323615%40googlegroups.com.