Databrick ALS Spark Job migration to GCP Server less spark tool

8 views

Skip to first unread message

Tomas Santandreu Polanco

unread,

Jul 2, 2024, 1:52:17 PM7/2/24

to Google Cloud Dataproc Discussions

Hi Team,

Do we have any tool that will help with the migration of a Databrick ALS Spark cluster to Server less Spark. The customer has tested a migrate version of the databrick to Dataproc but it fails to complete after 9 hours.
I am trying to see how we can extract any configuration from the Databrick Spark version and see what needs to be configure on the Serverless spark if any.

Thank you