Error while generating dataset.

76 views
Skip to first unread message

张醒之

unread,
Mar 16, 2017, 11:48:24 PM3/16/17
to Big Data Benchmark for BigBench
Hello,

I'm trying to runBenchMark on a hadoop cluster running hadoop 2.7.3.

In the dataGenetation-run_query.log, it shows as follows:

Error: java.io.IOException: ################# ERROR  Task 1/80 ###########################
Message:HadoopClusterExec.DEBUG_EXCEPTION_MESSAGESStackTrace:
java.io.IOException: HadoopClusterExec.DEBUG_EXCEPTION_MESSAGES
at io.bigdatabenchmark.hadoop.HadoopClusterExec$DistributedExecMapper.startChildProcess(HadoopClusterExec.java:792)
at io.bigdatabenchmark.hadoop.HadoopClusterExec$DistributedExecMapper.map(HadoopClusterExec.java:729)
at io.bigdatabenchmark.hadoop.HadoopClusterExec$DistributedExecMapper.map(HadoopClusterExec.java:1)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)


Is this a problem with the Hadoop cluster configuration, or JVM  configuration?

Thanks for the help in advance.
dataGeneration-run_query.log

Michael Frank

unread,
Mar 17, 2017, 2:40:59 AM3/17/17
to Big Data Benchmark for BigBench
Hi,
please remove "-testDebugMessages" from your conf/userSettings.conf. This option will throw an exection ON PURPOSE instead of executing the data generation job. It is ment do debug settings and environment issues, but in this case it masks your actual problem (return/error code 143). I will anwer in your other thread https://groups.google.com/forum/#!topic/big-bench/hqoQbnEzWII shortly after this one.

Cheers Michael
Reply all
Reply to author
Forward
0 new messages