Koert Kuipers
unread,Dec 15, 2011, 5:54:31 PM12/15/11Sign in to reply to author
Sign in to forward
You do not have permission to delete messages in this group
Sign in to report message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to cascadi...@googlegroups.com
i have a few subassemblies that i run after each other: A, B, and C
i save the results to a sink after A and also after C to a different sink.
now strangely the translation to map-reduce boils down to 2 map-reduce jobs that are run in parallel:
source => A => sink1
source => A => B => C => sink2
this way subassembly A is run twice, which was not my intention. what am i doing wrong?
code looks something like this:
Pipe pipe = new A(new Pipe("source"));
Pipe left = pipe;
Pipe right = pipe;
right = new B(right);
right = new C(right);
final Map<String, Tap> sinkMap = new ImmutableMap.Builder<String, Tap>().put("left", leftSink).put("right", rightSink).build();
final Flow flow = flowConnector.connect(sourceTap, sinkMap, new Pipe("left", left), new Pipe("right", right));