bigquery do not support protobuf?

565 views

Skip to first unread message

Liu Cheng

unread,

Apr 20, 2012, 11:42:31 AM4/20/12

to bigquery...@googlegroups.com

It is said that bigquery is an implementation of dremel, but I did not find any tutorial that tells about uploading protobuf-format data.

I wonder does bigquery supported nested data with repeated mode now?

Or could anyone please tell me how to upload protobuf-format data?

Many thanks!

Michael Manoochehri

unread,

Apr 20, 2012, 1:18:43 PM4/20/12

to bigquery...@googlegroups.com

Hi Liu:

The BigQuery API does not currently support ingestion of file formats besides CSV (one can also ingest gzipped CSV files). We also currently don't support creation of tables with nested records.

In order to use data stored in protobufs, you would have to export your data to a CSV format. Any nested data would have to be "flattened."

However, the BigQuery team is interested in developer feedback regarding additional data ingestion formats. What is your use case? Are there other data formats you are interested in using?