MetastoreReplicationJob 's Step3's input

35 views
Skip to first unread message

Zheng Shao

unread,
Nov 2, 2016, 9:07:05 PM11/2/16
to reair
Is Step3's input from Step1 or Step2?

The code is not consistent:
* In step-by-step mode, it's from Step2.
* In end-to-end mode, it's from Step1.

I guess it doesn't matter in reality (since they probably contains the same actions to take), but would be great to have a consistent way of handling this.


--
Zheng

Paul Yang

unread,
Nov 2, 2016, 10:27:23 PM11/2/16
to Zheng Shao, reair, Jingwei Lu
CC'ing Jingwei who is more familiar with batch replication.

--
You received this message because you are subscribed to the Google Groups "reair" group.
To unsubscribe from this group and stop receiving emails from it, send an email to airbnb-reair+unsubscribe@googlegroups.com.
To post to this group, send email to airbnb...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/airbnb-reair/CAAguJ7oVYnNfPDoYF-vovZLZTqSAaS_%2BnbbD%2BQ4aw1tPeV_oXg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Zheng Shao

unread,
Nov 3, 2016, 7:32:46 PM11/3/16
to Jingwei Lu, Paul Yang, reair
Hi Jingwei,


Zheng


On Wed, Nov 2, 2016 at 7:47 PM, Jingwei Lu <jingw...@airbnb.com> wrote:
You are correct. The step-by-step mode has a bug. Both step2 and step3 takes step1 output as input.

thanks,

Jingwei



--
Zheng

Paul Yang

unread,
Nov 3, 2016, 8:16:25 PM11/3/16
to Jingwei Lu, Zheng Shao, reair
Just worked out permission issues with Jingwei.

On Thu, Nov 3, 2016 at 4:53 PM, Jingwei Lu <jingw...@airbnb.com> wrote:
I am not authorized to merge.  Paul, please help Zheng to merge.

thanks,

Jingwei
Reply all
Reply to author
Forward
0 new messages