message.key.columns is not working

35 views
Skip to first unread message

Tharun Kumar J

unread,
May 27, 2024, 2:39:14 PM5/27/24
to CDAP User
Hi Guys,

We are using Data Fusion to replicate a MySQL table to BigQuery. Our requirement is to use a combination of three columns to uniquely identify a row from that table. Therefore, we are passing a runtime argument as follows: source.connector.message.key.columns=db.table:col1,col2,col3.

According to the documentation, this approach should work. However, I am encountering the following error:

"Worker Program 'DeltaWorker' failed with error: Table 'testing' in database 'mpao' has no primary key. Tables without a primary key are not supported."

Could you please advise if there is something I am doing wrong or if it is not possible to use a combination of columns as a unique identifier in this context?

Data Fusion version: 6.10.1

Mysql version: 8.0

I will attach more information the error.




Thank you for your assistance.

Screenshot from 2024-05-28 00-05-29.png
Reply all
Reply to author
Forward
0 new messages