KSQL Source to Target with KafkaConnect

5 views
Skip to first unread message

palus...@gmail.com

unread,
Apr 4, 2018, 7:14:48 PM4/4/18
to Confluent Platform
Goal:- Insert/update should be replicated from source to target.

I was able to do the following:-
Source Table -> Kafka Connector -> Altered the topic so that it is set to "Compact" -> Subsequent records  have the updated value => KC { Topic } =>Target ( Here every record is getting inserted as a stream ).

Please advise if it is possible to push the changes from a Table to Target as Unique rows instead of as a stream. Thank you so much.

Source
ID Name
=======
1 Test 1

Update Source
ID Name
=======
1 Test 2

At KSQL with compact enabled on table
ID Name
=======
1 Test 2

At Target I am getting two rows
ID Name
=======
1 Test 1
1 Test 2

Reply all
Reply to author
Forward
0 new messages