Dynamic retrieve the partition information

[Jiwei Cao]

Hi ALL:

    Is there any API to retrieve the partition columns for the delta lake table? Assue I just know the location is the delta lake table, and I can read the table and wants to figure out what is the partition columns.

--

Jiwei Cao Sr. Machine Learning Engineer Outreach Follow me on LinkedIn

 

[Chris Hoshino-Fish]

Hi Jiwei,

For Delta (and most spark tables), you can get partition information using DESCRIBE TABLE: https://docs.databricks.com/spark/latest/spark-sql/language-manual/sql-ref-syntax-aux-describe-table.html#examples

This should work for Spark use-cases.

-Chris

--
You received this message because you are subscribed to the Google Groups "Delta Lake Users and Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to delta-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/delta-users/CAGg%2BfX79tL1in4jjdGj_G8HguaHdiiLmWD6xE4OzXT4P7tWQ7A%40mail.gmail.com.

--

Chris Hoshino-Fish

Sr. Solutions Architect

Databricks Inc.

fi...@databricks.com

(415) 610-8520

Pronouns: He/Him/His

[Shixiong(Ryan) Zhu]

DESCRIBE DETAIL command returns the basic table information, including the partition columns: https://docs.delta.io/latest/delta-utility.html#retrieve-delta-table-details

Best Regards,

Ryan

To view this discussion on the web visit https://groups.google.com/d/msgid/delta-users/CAPiuPB12J5%3D8MSZOjzStC-YFxsTE_EM-R22_7b%2BdaVUF50jTFA%40mail.gmail.com.