Querying Data in Shared Tables using Delta Sharing

[Sunayana Rambhatla]

Consider the following scenario:
I have a Delta Lake data source and I am setting up Delta Sharing on top of it.

As a recipient, I have access to the shared tables using Delta Sharing.

My question is, instead of reading the entire data from the table, I want to perform some operations like filtering the data based on columns or aggregating the data in the shared tables.
Is there an option to achieve this?
If yes, can you pleas e give me a hint on how to do it.

Thanks in advance

[OKAWA Shingo]

Hi Sunayana.

> My question is, instead of reading the entire data from the table, I want to perform some operations like filtering the data based

> on columns or aggregating the data in the shared tables.
> Is there an option to achieve this?

You can use filter pushdown:

https://github.com/delta-io/delta-sharing/blob/main/PROTOCOL.md#sql-expressions-for-filtering

Regards,
Shingo

--
You received this message because you are subscribed to the Google Groups "Delta Lake Users and Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to delta-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/delta-users/9d08a76f-24a8-47d5-8f83-8559e6382aben%40googlegroups.com.