what's the most popular kafka library to use

[ami malimovka]

Currently I'm interested only in consuming/producing.

I'm aware of confluent-kafka-go and of sarama, and it looks like sarama has more github swag, but other than that I have no idea which one is better/more popular.

Is there an obvious choice here? what are people using now days (March 2023)


Thanks!

[Eli Lindsey]

Is there an obvious choice here? what are people using now days (March 2023)

I don’t think there’s an obvious choice, there’s three or four main libs, any of which may be good for different uses.

Some color on confluent-kafka-go - it's a wrapper around librdkafka. librdkafka is the main Kafka C lib and underpins many/most of the non-JVM language bindings. From that angle, if you’re looking for popularity it will surpass sarama. It also tends to have more of the esoteric or long-tail features implemented, though I haven’t done a feature comparison in awhile and it looks like that’s not relevant to you anyways. However it comes with the big caveat/potential pain point of requiring cgo.

segmentio/kafka-go is also worth considering. It’s my main goto if avoiding cgo.

-eli

--
You received this message because you are subscribed to the Google Groups "golang-nuts" group.
To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/golang-nuts/1f3e2106-9254-453c-905e-d51076210fbbn%40googlegroups.com.

[Vasiliy Tolstov]

I'm try all kafka libraries and my list:

1. github.com/twmb/franz-go/kgo - the best, no problems is around 1.5-2 years
2. github.com/segmentio/kafka-go (cool but have some errors 1.5 years ago, so i broke my production cluster with it)

-- 

Vasiliy Tolstov,
e-mail: v.to...@selfip.ru

На 13 марта 2023 г., 20:43:05, Eli Lindsey <e...@siliconsprawl.com> написали:

To view this discussion on the web visit https://groups.google.com/d/msgid/golang-nuts/3C38837C-3811-4ABF-A6D8-E349FE947FB9%40siliconsprawl.com.