Error while running converter.py

22 views
Skip to first unread message

RAMANI NATARAJAN

unread,
Jan 26, 2016, 12:52:25 PM1/26/16
to Hue-Users
Hello:

I am getting this error message (log below) when running converter.py to re-format the yelp_business JSON dataset into tab delimited. Any help to resolve this issue is appreciated.

Apache Pig version 0.12.0-cdh5.5.0 (rexported)
compiled Nov 09 2015, 12:41:48
Run pig script using PigRunner.run() for Pig version 0.8+
2016-01-26 09:25:00,093 [uber-SubtaskRunner] INFO  org.apache.pig.Main  - Apache Pig version 0.12.0-cdh5.5.0 (rexported) compiled Nov 09 2015, 12:41:48
2016-01-26 09:25:00,107 [uber-SubtaskRunner] INFO  org.apache.pig.Main  - Logging error messages to: /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1453822911018_0001/container_1453822911018_0001_01_000001/pig-job_1453822911018_0001.log
2016-01-26 09:25:00,470 [uber-SubtaskRunner] INFO  org.apache.pig.impl.util.Utils  - Default bootup file /var/lib/hadoop-yarn/.pigbootup not found
2016-01-26 09:25:01,021 [uber-SubtaskRunner] INFO  org.apache.hadoop.conf.Configuration.deprecation  - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2016-01-26 09:25:01,021 [uber-SubtaskRunner] INFO  org.apache.hadoop.conf.Configuration.deprecation  - fs.default.name is deprecated. Instead, use fs.defaultFS
2016-01-26 09:25:01,021 [uber-SubtaskRunner] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine  - Connecting to hadoop file system at: hdfs://quickstart.cloudera:8020
2016-01-26 09:25:01,053 [uber-SubtaskRunner] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine  - Connecting to map-reduce job tracker at: localhost:8032
2016-01-26 09:25:01,060 [uber-SubtaskRunner] WARN  org.apache.pig.PigServer  - Empty string specified for jar path
2016-01-26 09:25:01,558 [uber-SubtaskRunner] INFO  org.apache.hadoop.conf.Configuration.deprecation  - fs.default.name is deprecated. Instead, use fs.defaultFS
2016-01-26 09:25:01,575 [uber-SubtaskRunner] INFO  org.apache.hadoop.conf.Configuration.deprecation  - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2016-01-26 09:25:01,653 [uber-SubtaskRunner] INFO  org.apache.pig.scripting.jython.JythonScriptEngine  - created tmp python.cachedir=./tmp/pig_jython_1452569248124020506
2016-01-26 09:25:03,071 [communication thread] INFO  org.apache.hadoop.mapred.TaskAttemptListenerImpl  - Progress of TaskAttempt attempt_1453822911018_0001_m_000000_0 is : 1.0
2016-01-26 09:25:08,268 [uber-SubtaskRunner] WARN  org.apache.pig.scripting.jython.JythonScriptEngine  - pig.cmd.args.remainders is empty. This is not expected unless on testing.

Romain Rigaux

unread,
Jan 26, 2016, 1:40:01 PM1/26/16
to RAMANI NATARAJAN, Hue-Users
What MR logs are you seein?

--
You received this message because you are subscribed to the Google Groups "Hue-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hue-user+u...@cloudera.org.

Reply all
Reply to author
Forward
0 new messages