Full outer join on Delta merge operation rather left outer - version 0.6.1

112 views
Skip to first unread message

Oommen George

unread,
Dec 28, 2020, 6:27:30 PM12/28/20
to Delta Lake Users and Developers
Hi Experts ,
   I am using delta version 0.6.1 with spark 2.4.3 . When doing merging , I noticed full outer join is using . I have added merge filter conditions based on my partition keys to  eliminate unnecessary records . Is there any way this can keep left outer rather full outer on merge . 

Thanks ,
Oommen 

eugene....@gmail.com

unread,
Jan 5, 2021, 12:10:40 PM1/5/21
to Delta Lake Users and Developers

If your merge command doesn’t have the “insert” clause it will use right outer join

and it will use left anti join if only the “insert” clause is present

It will do that automatically.

 

Eugene

Reply all
Reply to author
Forward
0 new messages