Pulsar and Druid

132 views
Skip to first unread message

malachi

unread,
Apr 8, 2021, 7:51:23 AM4/8/21
to Druid User
Hello fellow Druids,
My current stream architecture is based around Apache Pulsar. Has anyone successfully connected Druid to Pulsar before? I know that Pulsar has an API masker that gives it the Kafka Java API. Does anyone know if the Kafka Java API is what Druid uses for Kafka Indexing? Thanks for any help you guys can provide!

Peter Marshall

unread,
Apr 16, 2021, 7:59:15 AM4/16/21
to Druid User
Hey Malachi - 

I saw this video a while ago from Overstock - it may be worth asking the presenter if they can provide any insights!  I think his contact details are on the front page of the talk...

Druid is just using the standard consumer - so i suspect if you can present Pulsar as a kafka 0.11+ endpoint, you can get going.  https://druid.apache.org/docs/0.20.2/development/extensions-core/kafka-ingestion.html

Reply all
Reply to author
Forward
0 new messages