Input Format Class in hydrator could not be found

[Pope Xie]

Hi,

  I created a plugin that has an Input Format Class jar as a dependency in the pom. The bundled jar was deployed. When started the pipeline , the Input Format Class in hydrator could not be found.

Thanks

Pope Xie

[Ali Anwar]

Hi Pope Xie.

Could you attach more details, such as the full stack trace of the errors?
Also, which InputFormat class did you use?

Regards,

Ali Anwar

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+unsubscribe@googlegroups.com.
To post to this group, send email to cdap...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/1792c2e1-7a87-41e1-8c29-66194bc3ab29%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Pope Xie]

java.lang.NullPointerException: Class could not be found:  [com.att.vetl.hadoop.WholeFileInputFormat]
	at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:235) ~[com.google.guava.guava-13.0.1.jar:na]
	at co.cask.cdap.internal.app.runtime.batch.dataset.input.DelegatingInputFormat.getSplits(DelegatingInputFormat.java:61) ~[co.cask.cdap.cdap-app-fabric-3.5.1.jar:na]
	at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:493) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na]
	at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:510) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na]
	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:394) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na]
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na]
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na]
	at java.security.AccessController.doPrivileged(Native Method) ~[na:1.7.0_75]
	at javax.security.auth.Subject.doAs(Subject.java:415) ~[na:1.7.0_75]
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) ~[org.apache.hadoop.hadoop-common-2.3.0.jar:na]
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na]
	at co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService.startUp(MapReduceRuntimeService.java:319) ~[co.cask.cdap.cdap-app-fabric-3.5.1.jar:na]
	at com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:47) ~[com.google.guava.guava-13.0.1.jar:na]
	at co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService$1$1.run(MapReduceRuntimeService.java:422) [co.cask.cdap.cdap-app-fabric-3.5.1.jar:na]
	at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]

On Tuesday, October 4, 2016 at 9:30:24 PM UTC-4, ali wrote:

Hi Pope Xie.

Could you attach more details, such as the full stack trace of the errors?
Also, which InputFormat class did you use?

Regards,

Ali Anwar

On Tue, Oct 4, 2016 at 6:10 PM, Pope Xie <pop...@hotmail.com> wrote:

Hi,

  I created a plugin that has an Input Format Class jar as a dependency in the pom. The bundled jar was deployed. When started the pipeline , the Input Format Class in hydrator could not be found.

Thanks

Pope Xie

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.

[Pope Xie]

This is input format class.

<dependency>

<groupId>com.att.vetl.hadoop</groupId>

<artifactId>inputformat</artifactId>

<version>1.0</version>

</dependency>

[Albert Shau]

Hi Pope,

Could you try including the inputformat package name in the _exportcontents section of the felix plugin part of your pom.xml? Something like 'com.att.vetl.hadoop.*'. If your plugin jar is not a snapshot version, you will need to delete the current plugin jar before re-deploying the new one.

Best,

Albert

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+unsubscribe@googlegroups.com.

To post to this group, send email to cdap...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/93c20f50-9081-4fee-ab19-148e772e5cef%40googlegroups.com.