[Hadoop-studio-users] Custom ObjectWritable caused a class not found exaception in the worlflow file input tab.

[guy doulberg]

Hey All

I have a custom writable object in many of my sequence files.
I am trying to use Karamsphere to write my code,
During the development I set the input file to be a sequence input file.
The Karampshere project can't find the class of the object in this file, and therefore fails.

Here is the log content form integration data:
java.lang.RuntimeException: java.io.IOException: WritableName can't load class: com.bla.hadoop.dataType.JSONObjectWritable
    at org.apache.hadoop.io.SequenceFile$Reader.getKeyClass(SequenceFile.java:1598)
    at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1548)
    at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1428)
    at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1417)
    at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1412)
    at org.apache.hadoop.mapreduce.lib.input.SequenceFileRecordReader.initialize(SequenceFileRecordReader.java:50)
    at com.karmasphere.studio.hadoop.mapreduce.model.hadoop.dev.InputFormatDelegate.run(InputFormatDelegate.java:64)
    at com.karmasphere.studio.hadoop.mapreduce.model.hadoop.HadoopInputModel$Delegate.run(HadoopInputModel.java:85)
    at com.karmasphere.studio.hadoop.mapreduce.model.hadoop.HadoopInputModel.update(HadoopInputModel.java:175)
    at com.karmasphere.studio.hadoop.mapreduce.model.core.AbstractOperatorModel.run(AbstractOperatorModel.java:380)
    at com.karmasphere.studio.hadoop.mapreduce.model.core.AbstractOperatorModel.post(AbstractOperatorModel.java:313)
    at com.karmasphere.studio.hadoop.mapreduce.model.hadoop.HadoopMapReduceJob.integrationChanged(HadoopMapReduceJob.java:422)
    at com.karmasphere.studio.hadoop.mapreduce.model.core.IntegrationSupport.fireIntegrationEvent(IntegrationSupport.java:62)
    at com.karmasphere.studio.hadoop.mapreduce.model.core.IntegrationSupport.fireIntegrationEvent(IntegrationSupport.java:68)
    at com.karmasphere.studio.hadoop.mapreduce.model.core.AbstractOperatorModel.run(AbstractOperatorModel.java:422)
    at org.openide.util.RequestProcessor$Task.run(RequestProcessor.java:577)
    at org.openide.util.RequestProcessor$Processor.run(RequestProcessor.java:1030)
Caused by: java.io.IOException: WritableName can't load class: com.bla.hadoop.dataType.JSONObjectWritable
    at org.apache.hadoop.io.WritableName.getClass(WritableName.java:73)
    at org.apache.hadoop.io.SequenceFile$Reader.getKeyClass(SequenceFile.java:1596)
    ... 16 more
Caused by: java.lang.ClassNotFoundException: com.bla.hadoop.dataType.JSONObjectWritable
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:627)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
    at org.apache.hadoop.io.WritableName.getClass(WritableName.java:71)
    ... 17 more


Any ideas, how could I add my custom writable to the class path of the karamsphere plugin?

Thanks

[Neena Kaushik]

Hi Guy,

Thank you for your question.

Currently, I don't have an answer to your question. Would it be possible for you to provide more information?

I would like to know:

1) The step-by-step procedure on how you created your project.
2) The sample input file.
3) The file for the custom writable class.

I will try out your sample project, and find out if there is a way to add the class to the classpath of the Karmasphere Studio plugin.

I am looking forward to hearing from you. Thanks.

Regards,
Neena Kaushik

------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! http://p.sf.net/sfu/intel-dev2devmar
_______________________________________________
Hadoop-studio-users mailing list
Hadoop-st...@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/hadoop-studio-users