Re: Airflow to Cloud composer migration

[Rafal Biegacz]

Ravi,

Please, check external documentation of Cloud Composer: https://cloud.google.com/composer/docs/migrate-composer-2-af-1 and other documents.

Regards, Rafal.

On Tue, Jul 12, 2022 at 11:53 PM 'Ravi Dalal' via cloud-composer-discuss <cloud-compo...@googlegroups.com> wrote:

Hello team,

Do we have any best practices, challenges or migration plan documentation for Airflow to Cloud Composer that can be shared with a customer? We have a customer who is planning to migration to Cloud Composer.

Also, can Airflow database schema be imported into Cloud Composer's Cloud SQL Postgres database as part of such migration?

Looking forward to any help on this.

Thank you.

Ravi

--
You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-di...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/9b89ac4a-4e46-49ca-a87f-8d4418745825n%40googlegroups.com.

[Alberto Vicente]

Hi Ravi,

Did you check official GCP Composer documentation?

[1] https://cloud.google.com/composer/docs/how-to

[2] https://cloud.google.com/composer/docs/concepts

Regards

Albert

On Tue, Jul 12, 2022 at 6:53 PM 'Ravi Dalal' via cloud-composer-discuss <cloud-compo...@googlegroups.com> wrote:

Hello team,

Do we have any best practices, challenges or migration plan documentation for Airflow to Cloud Composer that can be shared with a customer? We have a customer who is planning to migration to Cloud Composer.

Also, can Airflow database schema be imported into Cloud Composer's Cloud SQL Postgres database as part of such migration?

Looking forward to any help on this.

Thank you.

Ravi

--
You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-di...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/9b89ac4a-4e46-49ca-a87f-8d4418745825n%40googlegroups.com.

--

Alberto Vicente | Senior Tech Director - BizDev LATAM @ Data & AI Studio GLOBANT AR: +54 11 4109 1700 ext. 16054 | US: +1 877 215 5230 ext. 16054

The information contained in this e-mail may be confidential. It has been sent for the sole use of the intended recipient(s). If the reader of this message is not an intended recipient, you are hereby notified that any unauthorized review, use, disclosure, dissemination, distribution or copying of this communication, or any of its contents, is strictly prohibited. If you have received it by mistake please let us know by e-mail immediately and delete it from your system. Many thanks.

 

La información contenida en este mensaje puede ser confidencial. Ha sido enviada para el uso exclusivo del destinatario(s) previsto. Si el lector de este mensaje no fuera el destinatario previsto, por el presente queda Ud. notificado que cualquier lectura, uso, publicación, diseminación, distribución o copiado de esta comunicación o su contenido está estrictamente prohibido. En caso de que Ud. hubiera recibido este mensaje por error le agradeceremos notificarnos por e-mail inmediatamente y eliminarlo de su sistema. Muchas gracias.

[Rafal Biegacz]

Hi,

There is no migration guide per-se for self-managed Airflow to Composer/Composer2.

Composer 1/AF2 -> Composer 2/AF2: https://cloud.google.com/composer/docs/migrate-composer-2-af-2

Composer 1/AF1 -> Composer 2/AF2: https://cloud.google.com/composer/docs/migrate-composer-2-af-1

Composer doesn't support the concept of "importing Airflow database schema". You can upload the content of AF1 db into AF2 db (adjustment of the data schema will be done during the import process).

Regards, Rafal.

On Wed, Jul 13, 2022 at 6:45 PM 'Ravi Dalal' via cloud-composer-discuss <cloud-compo...@googlegroups.com> wrote:

Rafal,

All the guides in our public documentation are for Cloud Composer to Cloud Composer migrations and one guide is for Airflow 1 to Airflow 2 migration. I do not see any documentation for on-premises Airflow (1 or 2) to Cloud Composer (1 or 2) migration. Therefore, these links are not helpful for my customer engagement.

Ravi

To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/CAHCHhbazvcK_u2QP9r7UfrHe4dUJoWi%3DX90Ards6eSa_JHAApg%40mail.gmail.com.