Kafka + Spark Streaming: Any sample of Avro serialization in scala ?

25 views
Skip to first unread message

Omar Meza

unread,
Oct 23, 2018, 3:54:01 PM10/23/18
to Registry
Hi!

Looking to implement an Avro serdes with Scala and Schema Registry producing/consuming messages from Kafka + Spark Streaming ...

Any suggestions?

Thank you!
Omar

aiyer

unread,
Oct 23, 2018, 9:13:58 PM10/23/18
to Registry
Checkout https://github.com/hortonworks-spark/spark-schema-registry

It provides apis for you to directly integrate schema registry with spark data frames.

There are Kafka-Spark structured streaming examples that shows how to use it (similar to what you are looking for).

- Arun
Reply all
Reply to author
Forward
0 new messages