proper way of running next job in scalding

[Neeraj Nagi]

I have tried these formats for defining next job but they all result in 

xception in thread "main" cascading.flow.planner.PlannerException: source taps are required

        at cascading.flow.planner.FlowPlanner.verifyTaps(FlowPlanner.java:170)

        at cascading.flow.planner.FlowPlanner.verifyAssembly(FlowPlanner.java:121)

        at cascading.flow.local.planner.LocalPlanner.buildFlow(LocalPlanner.java:57)

        at cascading.flow.FlowConnector.connect(FlowConnector.java:454)

class KcenterClustering(args: Args) extends Job(args){

  override def next : Option[Job] = Some(new CalculateClusterNode(args, args("clusterSize").toInt , Array("9q8up7n")))

}

or

class KcenterClustering(args: Args) extends Job(args){

new CalculateClusterNode(args, args("clusterSize").toInt , Array("9q8up7n"))

}

CalculateClusterNode is also a scalding job

Any guidance is most welcome.

[Oscar Boykin]

The Job you return must actually do something in the constructor of that job. Just making another job in the body, won't work.

See:

https://github.com/twitter/scalding/blob/develop/scalding-core/src/main/scala/com/twitter/scalding/examples/PageRank.scala#L53

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at http://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/44e98176-566e-4f4c-927a-77831ef79898%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--

Oscar Boykin :: @posco :: http://twitter.com/posco

[Neeraj Nagi]

Thanks a lot, you set me in the right direction. I woke up and found your answer. You literally made my day