Split class cascading.tap.hadoop.io.MultiInputSplit not found

[Pankaj Sinha]

I understand that this question has been asked a lot of times, but I was not able to get the things to work even after following the different approaches.

I'm running my jar file from command line and its failing with the error : java.io.IOException: Split class cascading.tap.hadoop.io.MultiInputSplit not found

I thought that this is due to the cascading jar files are not available to the task nodes, therefore tried to run my jar using the command

1) hadoop jar my_jar.jar myClassName -files list of jars which are separated by spaces

2.) hadoop jar my_jar.jar myClassName -libjars list of jars which are separated by comma

3.) it is mostly advised "Try adding something like "cascading.app.appjar.class" = MyClass.class to the job conf. "

I tried to add that in the core-site.xml by specifying the property:

<property>

    <name>cascading.app.appjar.class</name>

    <value>myClassName.class</value>

</property>

but that did not work either, could somebody please advise how to resolve this error ?  Really appreciate your help. Thanks.

[Pankaj Sinha]

I did set the AppProps.setApplicationJarClass earlier but after reading now I've set the AppProps.setApplicationJarPath as well.

I'm not sure why the error is getting popped.

[Pankaj Sinha]

i have multiple jar files for cascading, but the AppProps.setApplicationJarPath can take only one Path.

Can somebody please suggest how to put all the cascading jar files in order to avoid the class not found exception ?

Thanks.

[Chris K Wensel]

Cascading does not overcome the need to properly package your Hadoop Job Jar, which is well documented on the Hadoop site.

some pointers are there though..

http://docs.cascading.org/cascading/2.5/userguide/htmlsingle/#N20DAF

-- 
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at http://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/1ba507fd-3c0f-4911-95df-527c2505007e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Chris K Wensel

ch...@concurrentinc.com

http://concurrentinc.com

[Pankaj Sinha]

Thanks Chris,

I was able to sort this issue by creating one combined jar file for Cascading and putting its path in the properties (SetApllicationJarPath) 

[sam...@gmail.com]

hi Pankaj,

Is it something you are creating fat jar with all dependencies. May i know the POM configuration that u used.I am also facing the same issue. It works fine for me when i copy dependencies to my build directory

thank you