Missing commit in Cascading 3.2-wip3?

[Piyush Narang]

hey folks,

While testing out the 3.2-wip3 release with some of our internal Scalding E2E tests, one of jobs seems to be failing with this error:

ERROR: Job failed with exception: union of steps have 1 fewer elements than parent assembly: MapReduceHadoopRuleRegistry, missing: [Each(_pipe_0+_pipe_1)[FlatMapFunction[decl:'mergeError']]] cascading.flow.planner.PlannerException: union of steps have 1 fewer elements than parent assembly: MapReduceHadoopRuleRegistry, missing: [Each(_pipe_0+_pipe_1)[FlatMapFunction[decl:'mergeError']]] at cascading.flow.planner.FlowPlanner.verifyResultInternal(FlowPlanner.java:621) at cascading.flow.planner.FlowPlanner.verifyResult(FlowPlanner.java:560) at cascading.flow.planner.rule.RuleSetExec.execPlannerFor(RuleSetExec.java:163) at cascading.flow.planner.rule.RuleSetExec$3.call(RuleSetExec.java:336) at cascading.flow.planner.rule.RuleSetExec$3.call(RuleSetExec.java:328) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)

Seems like this was fixed in commit: https://github.com/cwensel/cascading/commit/4a94e5512f9b1b9f906f9d19dead78eca7d10857

That seems to be the only commit missed in 3.2-wip3: https://github.com/cwensel/cascading/compare/3.2-wip-3...wip-3.1

As this failure seems to be in the planning phase it fails fast, I see the error even when we try to dump the dot graph. I tried out a test run of the 3.2-wip3 branch + this commit and that seems to have gone through fine. Would it be possible to publish a 3.2 wip with this commit included? 

Thanks,

Piyush

[Chris K Wensel]

I haven’t merged the wip 3.1 tree into wip-3.2 yet as we haven’t released the pending maintenance release on wip-3.1. once that’s done I can pull over the 3.1 commits to 3.2..

sounds like I should make that release sooner than later.

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at https://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/6c0baaf7-36d3-4e29-9047-19567d9ae203%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

—

Chris K Wensel

ch...@wensel.net