Graph Vertex Issue

[Wil Stuckey]

Hey there I wrote a new source for sinking to Graphite in scalding but when I try to use it in a job I'm getting the following error:

cascading.flow.planner.PlannerException: could not build flow from assembly: [no such vertex in graph]

        at cascading.flow.planner.FlowPlanner.handleExceptionDuringPlanning(FlowPlanner.java:502)

        at cascading.flow.hadoop.planner.HadoopPlanner.buildFlow(HadoopPlanner.java:230)

        at cascading.flow.FlowConnector.connect(FlowConnector.java:454)

        at com.twitter.scalding.Job.buildFlow(Job.scala:93)

        at com.etsy.scalding.ScaldingRunnable.buildFlows(ScaldingRunnable.scala:23)

        at cascading.jruby.CascadingRunnable.prepare(CascadingRunnable.java:30)

        at cascading.jruby.Main.run(Main.java:111)

        at org.apache.oozie.action.hadoop.FreestandingRunner.run(FreestandingRunner.java:51)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

        at org.apache.oozie.action.hadoop.FreestandingRunner.main(FreestandingRunner.java:59)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at org.apache.hadoop.util.RunJar.main(RunJar.java:208)

Caused by: java.lang.IllegalArgumentException: no such vertex in graph

        at org.jgrapht.graph.AbstractGraph.assertVertexExist(Unknown Source)

        at org.jgrapht.graph.AbstractBaseGraph.addEdge(Unknown Source)

        at cascading.flow.planner.ElementGraph.makeGraph(ElementGraph.java:300)

        at cascading.flow.planner.ElementGraph.assembleGraph(ElementGraph.java:164)

        at cascading.flow.planner.ElementGraph.<init>(ElementGraph.java:118)

        at cascading.flow.planner.FlowPlanner.createElementGraph(FlowPlanner.java:142)

        at cascading.flow.hadoop.planner.HadoopPlanner.buildFlow(HadoopPlanner.java:195)

        ... 14 more

The message is a little vague, where should I be looking to resolve this.

Thanks,

Wil

[Christopher Severs]

I had a similar error with my Avro source. The fix was to make the hash function in the Scheme to be independent of the sink (or source, I can double check if it's important) since it could get modified during flow planning (which normally doesn't happen but I have a few odd things in the scheme).