Problem connecting to Google BigQuery, Kafka-BigQuery connector issue

267 views
Skip to first unread message

Mich Talebzadeh

unread,
Mar 23, 2021, 6:18:29 AM3/23/21
to Confluent Platform

Hi,

Has anyone managed to connect and deliver Json data to BigQuery table on Google Cloud from on-premise source?


We are trying to use wepay Google BigQuery Sink Connector to send both the schema and payload in Kafka message but getting 


"Error: Top-level Kafka Connect schema must be of type 'struct' (org.apache.kafka.connect.runtime.WorkerSinkTask:612)"


I have also put this in the following stackspace thead.


kafka connect to Google BigQuery throws error Kafka Connect schema must be of type 'struct' - Stack Overflow


It is possible that this is a genuine bug in wepay as we have tried many suggestions as well.

Appreciate any feedback

Many thanks,


Mich


Reply all
Reply to author
Forward
0 new messages