Read table_changes for "change data feed" enabled delta lake table from different workspace

226 views
Skip to first unread message

asi...@gmail.com

unread,
Jul 28, 2021, 4:56:43 AM7/28/21
to Delta Lake Users and Developers
Hi 
I have 2 different Databricks  workspaces sharing same Azure Storage for Delta lake 
I have enabled change data feed for some tables ( a new feature in 8.4 runtime) from Workspace 1 as per documentation 

https://docs.databricks.com/delta/delta-change-data-feed.html?_ga=2.223568344.210727485.1627269919-1007417839.1622706382

 

However, the problem is that I can't find "table_changes" table in Workspace 2 as we don't have any option to share metastore. Its only the deltalake which is shared between 2 workspaces


Is there any workaround for this ?


Thanks

Shixiong(Ryan) Zhu

unread,
Aug 2, 2021, 2:58:09 PM8/2/21
to asi...@gmail.com, Delta Lake Users and Developers
There is a "table_changes_by_path" function you can use to access the change data feed from a table using its path. For example,

SELECT * FROM table_changes_by_path('<the-path-to-your-delta-table>', '2021-04-21 05:45:46')

Best Regards,

Ryan


--
You received this message because you are subscribed to the Google Groups "Delta Lake Users and Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to delta-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/delta-users/8e07858a-8523-47dd-be42-c191422250ccn%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages