Hi guys,
I use cascading 2.2.1. and the following is my code.
public class Main {
@SuppressWarnings({ "rawtypes" })
public static void main(String[] args) {
String inPath = args[0];
String outPath = args[1];
Properties properties = new Properties();
AppProps.setApplicationJarClass(properties, Main.class);
HadoopFlowConnector flowConnector = new HadoopFlowConnector(properties);
// create the source tap
Tap inTap = new Hfs(new TextDelimited(true, "\t"), inPath);
// create the sink tap
Tap outTap = new Hfs(new TextDelimited(true, "\t"), outPath);
// specify a pipe to connect the taps
Pipe copyPipe = new Pipe("copy");
// connect the taps, pipes, etc., into a flow
FlowDef flowDef = FlowDef.flowDef().addSource(copyPipe, inTap)
.addTailSink(copyPipe, outTap);
// run the flow
flowConnector.connect(flowDef).complete();
}
}
but when I run it on hadoop cluster it throw the exception:
cascading.flow.planner.PlannerException: could not build flow from assembly: [no such vertex in graph]
the execution command is "hadoop jar Cascading.jar /user/maguolai/temp.txt /user/maguolai/output"
Could anyone give me some suggestions, and thanks a lot!