Exception "Output directory not set" when ran "FileSetExample" in CDAP UI

265 views
Skip to first unread message

qliu_us

unread,
Oct 12, 2016, 10:56:56 PM10/12/16
to CDAP User
I ran Cdap provided example "FileSetExample version 3.5.1" on both my PC and our cluster. I got Exception in both environments. I followed the steps that described in cdap website for FileSetExample. The only thing I did differently was that I started mapreduce "WordCount" from Cdap UI. I got an error below.  Would you let me know how to get this resolved? Thanks

Lucy

16-10-12 22:10:26,807 - ERROR [MapReduceRunner-WordCount:c.c.c.i.a.r.ProgramControllerServiceAdapter@81] - Program terminated with exception
org.apache.hadoop.mapred.InvalidJobConfException: Output directory not set.
	at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:138) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na]
	at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:458) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na]

Ali Anwar

unread,
Oct 13, 2016, 1:14:29 AM10/13/16
to cdap...@googlegroups.com
Hey Lucy.

Take a look at the documentation for the example: http://docs.cdap.io/cdap/3.5.0/en/examples-manual/examples/fileset-example.html.

The MapReduce needs to be run with certain runtime arguments. The docs use the CLI. If you want to run it from the UI, you will have to set the same arguments from the UI before running the program.

Regards,

Ali Anwar

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+unsubscribe@googlegroups.com.
To post to this group, send email to cdap...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/d11ae521-8b0a-4d77-9653-0638125a2f1a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages