dataflow operator how to set beam version

[Stefano Giostra]

Hi everyone,

if I generate a DataFlow JOB from GCP Dataflow UI, the dataflow job uses the version 2.10.0 of Beam SDK.

If I use a dataflow operator  from Airflow (Cloud Composer), the dataflow job uses the version 2.5.0 of Beam SDK

Wath can I do to use the 2.10.0 version also with Airflow?

Thanks

[Cameron Moberg]

Hey Stefano,

I've done some reading on the topic and it looks like the package we're using's most recent release is `google-cloud-dataflow` at 2.5.0.
I think the best thing you can do right now is to try to install the pypi package of "apache-beam"

Thanks for bringing this to our attention that we should look at this, let us know if that works!

--
You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-di...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/9acf1ec8-e4c9-42b2-bf65-48f75a4e023e%40googlegroups.com.