Kafka Stream Changelog topic config

791 views
Skip to first unread message

Michael Kohout

unread,
Dec 7, 2017, 3:41:33 PM12/7/17
to Confluent Platform
Hi, sorry for such a simple questions but I don't see any documentation that clearly addresses my question

Is there any documentation on the acceptable config options for that can be passed to Materialized.withLoggingEnabled(final Map<String, String> config) ?

Specifically, is there any way to control the created changelog topic name?

thanks

Hyun Joon Seol

unread,
Dec 7, 2017, 3:51:50 PM12/7/17
to Confluent Platform
If you give a name with `Materialized.as($NAME)`, the changelog topic will take that name.

Michael Kohout

unread,
Dec 7, 2017, 4:41:43 PM12/7/17
to Confluent Platform
Hmm, I don't seem to be getting that exact result-

from this definition:
KTable<String, String> t = builder.table("topicName", Consumed.with(Serdes.String(), Serdes.String()).withOffsetResetPolicy(Topology.AutoOffsetReset.EARLIEST), Materialized.as("topicStore"))
I'm getting a topic named

${application id}-topicStore-changelog


Am I missing something?


By the way this is for kafka-streams v1.0


thanks again.


Matthias J. Sax

unread,
Dec 7, 2017, 5:05:23 PM12/7/17
to confluent...@googlegroups.com
Your observation is correct. And you cannot specify an arbitrary topic
name. This would break `bin/kafka-streams-application-reset` that relies
on the current naming schema for internal topics.


-Matthias
> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.
> To post to this group, send email to confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/831ea451-f02a-40dc-af61-2d106b4d2325%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/831ea451-f02a-40dc-af61-2d106b4d2325%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.

signature.asc

Michael Kohout

unread,
Dec 7, 2017, 6:06:48 PM12/7/17
to Confluent Platform
Ok.  Thanks for your answer.
Reply all
Reply to author
Forward
0 new messages