Orchestrate Dataproc (serverless) batch jobs

[R1]

Hi guys,

I have multiple dependent  spark jobs which I want to run in a serverless way. How do I Orchestrate them so that they run in that order? 

[amancuso...@gmail.com]

This may help: "Schedule Dataproc Serverless for Spark batch workloads" on What is Dataproc Serverless?

[bla...@google.com]

Hi folks --

For orchestration, we recommend that you create a Cloud Composer 2 instance, aka managed Apache Airflow, and "Run Dataproc Serverless workloads with Cloud Composer".

Best,

Blake