Full outer join on Delta merge operation rather left outer - version 0.6.1
112 views
Skip to first unread message
Oommen George
unread,
Dec 28, 2020, 6:27:30 PM12/28/20
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to Delta Lake Users and Developers
Hi Experts ,
I am using delta version 0.6.1 with spark 2.4.3 . When doing merging , I noticed full outer join is using . I have added merge filter conditions based on my partition keys to eliminate unnecessary records . Is there any way this can keep left outer rather full outer on merge .
Thanks ,
Oommen
eugene....@gmail.com
unread,
Jan 5, 2021, 12:10:40 PM1/5/21
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to Delta Lake Users and Developers
If your merge command doesn’t have the “insert” clause it will use right outer join
and it will use left anti join if only the “insert” clause is present