[ANNOUNCE] SparkClient Support in Kubeflow SDK

[Andrey Velichkevich]

Hi Kubeflow Community,

Over the past few months, we've been working on integrating the Spark Operator into the Kubeflow SDK.
Recently, we expanded this work to support Spark batch job submissions in addition to interactive Spark sessions.
Our goal is to provide a Pythonic developer experience for running and managing Spark on Kubernetes, without requiring users to understand Kubernetes internals.

We'll be giving a demo of the new SparkClient APIs during tomorrow's Spark on Kubernetes community call, and we'd love for you to join!

📅 July 24th 9:00AM PST 

You can also fine the detailed proposal here: https://github.com/kubeflow/sdk/tree/main/proposals/107-spark-client

Regards,

Andrey

[Vikas Saxena]

Great work guys, I have been working on something similar using kubeflow notebooks which I am going to present in the Virtual Symposium next month. It would be good to see if this can be used by users to deploy a sparkConnect Service in their profile/namespace

--
You received this message because you are subscribed to the Google Groups "kubeflow-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kubeflow-discu...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/kubeflow-discuss/CAHHFJt%3DY%3D2pVRzXFWqXh7FZE_8y2Si2VX-A4KRMZj%3DM-vKGniw%40mail.gmail.com.

--

Thanks and regards,
Vikas Saxena.