Rmr2 fails on a Hadoop MapM5 5 nodes clusters

229 views

Skip to first unread message

Brunob

unread,

Jun 26, 2015, 6:39:33 AM6/26/15

to rha...@googlegroups.com

Hello,

We have a five nodes cluster Hadoop MapR M5

We use hadoop 2.4.1 on YARN (High avability of ressource manager -->3)

Hadoop Streaming process without rmr work very well.

All hosts are on Centos 6.5

R is installed and works fine.

R is installed on every nodes

R version 3.1.2 (2014-10-31) -- "Pumpkin Helmet"

Platform: x86_64-redhat-linux-gnu (64-bit)

Rhdfs installed and work fine

Rmr2

Version 3.3.2

Rscript can be crontabed without problem

R and Rscript are on a path that every mapreduce job can access because i ran a streaming process with Ruby that is on the same system path.

This error is reported on many blogs but no solutions work.

I also tried to change mapred-site.xml and set the mapreduce.map.env property to access path of R.

When we run

export HADOOP_STREAMING=/opt/mapr/hadoop/hadoop-2.4.1/hadoop-streaming-2.4.1.jar

export HADOOP_CONF=/opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/

export HADOOP_CMD=/opt/mapr/hadoop/hadoop-2.4.1/bin/hadoop

R --no-save < /tmp/wordcount.R; echo $?

We have the following error

Error: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1469) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106) ... 9 more Caused by: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133) at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38) ... 14 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106) ... 17 more Caused by: java.lang.RuntimeException: configuration exception at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:222) at org.apache.hadoop.streaming.PipeMapper.configure(PipeMapper.java:66) ... 22 more Caused by: java.io.FileNotFoundException: File /tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435245722499_0001/container_1435245722499_0001_01_000002/Rscript does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:511) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:781) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:501) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:397) at org.apache.hadoop.fs.FileUtil.chmod(FileUtil.java:887) at org.apache.hadoop.fs.FileUtil.chmod(FileUtil.java:863) at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:180) ... 23 mor

Thank you for your help.

Antonio Piccolboni

unread,

Jul 1, 2015, 2:04:43 PM7/1/15

to rha...@googlegroups.com, bbouc...@gmail.com

try a job like this to gather some insight on the job's execution environment

hadoop jar $HADOOP_STREAMING -input <one line text file> -output <any valid path> -mapper env

Do an hdfs dfs get on the output, then sort <local file> | uniq

Then post the output here. Let me know if some part of the instructions is not clear. The parts between <> require you to provide the correct value.

The problem is that mapreduce is apparently looking for Rscript in the working dir, which is wrong. You are insisting that the program is installed on every node and accessible, but it may be true for one user and not another one, or only for interactive logins (some people set the PATH variable in their .bashrc for instance). You may be unable to log into a node as the user that will execute hadoop jobs, as that user is often configured with a nologin shell or equivalent. The devil is in the details.

Brunob

unread,

Jul 6, 2015, 2:16:52 AM7/6/15

to rha...@googlegroups.com, bbouc...@gmail.com

Thank you for your help Antonio.

I have the same problem when I try to launch a command

hadoop jar $HADOOP_STREAMING -input <one line text file> -output <any valid path> -mapper env

I tried to set PATH environnement variable in .bashrc
I tried to set the mapreduce.map.env (and restart node manager and ressource manager) with no effect

This is the result of my command

hadoop jar $HADOOP_STREAMING -input test.txt -output a -mapper env

[mapr@host-XX-XX-126-13 ~]$ hadoop jar $HADOOP_STREAMING -input test.txt -output a -mapper env

packageJobJar: [/tmp/hadoop-mapr/hadoop-unjar6691228448568642815/] [] /tmp/streamjob8904360413839075860.jar tmpDir=null

15/07/03 16:12:08 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2

15/07/03 16:12:47 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm3

15/07/03 16:12:48 INFO mapred.FileInputFormat: Total input paths to process : 1

15/07/03 16:12:48 INFO mapreduce.JobSubmitter: number of splits:2

15/07/03 16:12:48 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1435654568925_0006

15/07/03 16:12:48 INFO security.ExternalTokenManagerFactory: Initialized external token manager class - com.mapr.hadoop.yarn.security.MapRTicketManager

15/07/03 16:12:48 INFO impl.YarnClientImpl: Submitted application application_1435654568925_0006

15/07/03 16:12:48 INFO mapreduce.Job: The url to track the job: http://host-XX-XX-126-14.openstacklocal:8088/proxy/application_1435654568925_0006/

15/07/03 16:12:48 INFO mapreduce.Job: Running job: job_1435654568925_0006

15/07/03 16:13:45 INFO mapreduce.Job: Job job_1435654568925_0006 running in uber mode : false

15/07/03 16:13:45 INFO mapreduce.Job: map 0% reduce 0%

15/07/03 16:13:51 INFO mapreduce.Job: Task Id : attempt_1435654568925_0006_m_000001_0, Status : FAILED

Caused by: java.io.FileNotFoundException: File /tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0006/container_1435654568925_0006_01_000002/env does not exist

        at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:511)

        at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:781)

        at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:501)

        at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:397)

        at org.apache.hadoop.fs.FileUtil.chmod(FileUtil.java:887)

        at org.apache.hadoop.fs.FileUtil.chmod(FileUtil.java:863)

        at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:180)

... 23 more

15/07/03 16:13:51 INFO mapreduce.Job: Task Id : attempt_1435654568925_0006_m_000000_0, Status : FAILED

Caused by: java.io.FileNotFoundException: File /tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0006/container_1435654568925_0006_01_000003/env does not exist

... 23 more

15/07/03 16:13:56 INFO mapreduce.Job: Task Id : attempt_1435654568925_0006_m_000001_1, Status : FAILED

Caused by: java.io.FileNotFoundException: File /tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0006/container_1435654568925_0006_01_000004/env does not exist

... 23 more

15/07/03 16:13:56 INFO mapreduce.Job: Task Id : attempt_1435654568925_0006_m_000000_1, Status : FAILED

Caused by: java.io.FileNotFoundException: File /tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0006/container_1435654568925_0006_01_000005/env does not exist

... 23 more

15/07/03 16:14:00 INFO mapreduce.Job: Task Id : attempt_1435654568925_0006_m_000001_2, Status : FAILED

Caused by: java.io.FileNotFoundException: File /tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0006/container_1435654568925_0006_01_000006/env does not exist

... 23 more

15/07/03 16:14:01 INFO mapreduce.Job: Task Id : attempt_1435654568925_0006_m_000000_2, Status : FAILED

Caused by: java.io.FileNotFoundException: File /tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0006/container_1435654568925_0006_01_000007/env does not exist

        ... 23 more

15/07/03 16:14:05 INFO mapreduce.Job: map 100% reduce 100%

15/07/03 16:14:06 INFO mapreduce.Job: Job job_1435654568925_0006 failed with state FAILED due to: Task failed task_1435654568925_0006_m_000001

Job failed as tasks failed. failedMaps:1 failedReduces:0

15/07/03 16:14:06 INFO mapreduce.Job: Counters: 15

        Job Counters

                Failed map tasks=7

                Killed map tasks=1

                Launched map tasks=8

                Other local map tasks=6

                Data-local map tasks=1

                Rack-local map tasks=1

                Total time spent by all maps in occupied slots (ms)=26797

                Total time spent by all reduces in occupied slots (ms)=0

                Total time spent by all map tasks (ms)=26797

                Total vcore-seconds taken by all map tasks=26797

                Total megabyte-seconds taken by all map tasks=27440128

                DISK_MILLIS_MAPS=13401

        Map-Reduce Framework

                CPU time spent (ms)=0

                Physical memory (bytes) snapshot=0

                Virtual memory (bytes) snapshot=0

15/07/03 16:14:06 ERROR streaming.StreamJob: Job not Successful!

Streaming Command Failed!

Thank you

Brunob

unread,

Jul 6, 2015, 4:56:57 AM7/6/15

to rha...@googlegroups.com

Hello,

I can run the command with the full path specification /bin/env

hadoop jar $HADOOP_STREAMING -input <one line text file> -output <any valid path> -mapper /bin/env

I joined the result in the file rmr2_retour.txt

thank you

...

rmr2_retour.txt

Antonio Piccolboni

unread,

Jul 6, 2015, 1:08:12 PM7/6/15

to rha...@googlegroups.com

OK, so we now know it's not an rmr-only problem. Try and replace env with /bin/env or /usr/bin/env.

--
post: rha...@googlegroups.com ||
unsubscribe: rhadoop+u...@googlegroups.com ||
web: https://groups.google.com/d/forum/rhadoop?hl=en-US
---
You received this message because you are subscribed to the Google Groups "RHadoop" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rhadoop+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Brunob

unread,

Jul 6, 2015, 2:49:40 PM7/6/15

to rha...@googlegroups.com, ant...@piccolboni.info

Yes it's not a rmr only problem.
In my previous post, i launched with /bin/env and it worked fine for the streaming process (hadoop jar $HADOOP_STREAMING -input <one line text file> -output <any valid path> -mapper /bin/env).
How do we specify full path for rmr ?
Or is a way to make it work for Rscript ? I haven't access to path spécification when i launch a R script.
I tried to start the R script with #! /usr/bin/env Rscript without success.

Thank you for your help

Antonio Piccolboni

unread,

Jul 6, 2015, 4:39:47 PM7/6/15

to rha...@googlegroups.com

You are free to try whatever you want, but what I am asking you to do is to perform specific activities that allow me to troubleshoot your problem. Therefore I am only interested in the output of this streaming job, the version that worked with env's full path. Not the logs, the output. If you sent it already I missed it among all these other things you are reporting. Please do only one thing or at least report only about the one thing I am asking in the next message.

Brunob

unread,

Jul 7, 2015, 4:11:01 AM7/7/15

to rha...@googlegroups.com, ant...@piccolboni.info

Ok. I understand.

This is the output on HDFS of the streaming job with env commande full path (hadoop jar $HADOOP_STREAMING -input <one line text file> -output <any valid path> -mapper /bin/env).

AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA==

CLASSPATH=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000002:/opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/common/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/common/lib/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/hdfs/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/hdfs/lib/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/yarn/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/yarn/lib/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/mapreduce/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/mapreduce/lib/*:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000002/*

CLASSPATH=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000003:/opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/common/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/common/lib/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/hdfs/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/hdfs/lib/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/yarn/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/yarn/lib/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/mapreduce/*:/opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/mapreduce/lib/*:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000003/*

CONTAINER_ID=container_1435654568925_0017_01_000002

CONTAINER_ID=container_1435654568925_0017_01_000003

dfs_bytes_per_checksum=512

dfs_ha_fencing_ssh_connect_timeout=30000

dfs_namenode_checkpoint_dir=/tmp/hadoop-mapr/dfs/namesecondary

dfs_namenode_checkpoint_edits_dir=/tmp/hadoop-mapr/dfs/namesecondary

dfs_namenode_checkpoint_period=3600

file_blocksize=67108864

file_bytes_per_checksum=512

file_client_write_packet_size=65536

file_replication=1

file_stream_buffer_size=4096

fs_AbstractFileSystem_file_impl=org.apache.hadoop.fs.local.LocalFs

fs_AbstractFileSystem_hdfs_impl=com.mapr.fs.MFS

fs_AbstractFileSystem_maprfs_impl=com.mapr.fs.MFS

fs_AbstractFileSystem_viewfs_impl=org.apache.hadoop.fs.viewfs.ViewFs

fs_automatic_close=true

fs_checkpoint_size=67108864

fs_client_resolve_remote_symlinks=true

fs_defaultFS=maprfs:///

fs_df_interval=60000

fs_du_interval=600000

fs_file_impl=org.apache.hadoop.fs.LocalFileSystem

fs_ftp_host=0.0.0.0

fs_ftp_host_port=21

fs_ftp_impl=org.apache.hadoop.fs.ftp.FTPFileSystem

fs_har_impl_disable_cache=true

fs_har_impl=org.apache.hadoop.fs.HarFileSystem

fs_hdfs_impl=com.mapr.fs.MapRFileSystem

fs_hftp_impl=org.apache.hadoop.hdfs.HftpFileSystem

fs_hsftp_impl=org.apache.hadoop.hdfs.HsftpFileSystem

fs_kfs_impl=org.apache.hadoop.fs.kfs.KosmosFileSystem

fs_maprfs_impl=com.mapr.fs.MapRFileSystem

fs_mapr_working_dir=/user/$USERNAME/

fs_permissions_umask_mode=022

fs_ramfs_impl=org.apache.hadoop.fs.InMemoryFileSystem

fs_s3_block_size=33554432

fs_s3_blockSize=33554432

fs_s3_buffer_dir=/tmp/hadoop-mapr/s3

fs_s3_impl=org.apache.hadoop.fs.s3native.NativeS3FileSystem

fs_s3_maxRetries=4

fs_s3n_block_size=33554432

fs_s3n_blockSize=33554432

fs_s3n_impl=org.apache.hadoop.fs.s3native.NativeS3FileSystem

fs_s3n_multipart_copy_block_size=5368709120

fs_s3n_multipart_uploads_block_size=67108864

fs_s3n_multipart_uploads_enabled=false

fs_s3_sleepTimeSeconds=10

fs_swift_impl=org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystem

fs_trash_checkpoint_interval=0

fs_trash_interval=0

fs_webhdfs_impl=org.apache.hadoop.hdfs.web.WebHdfsFileSystem

ftp_blocksize=67108864

ftp_bytes_per_checksum=512

ftp_client_write_packet_size=65536

ftp_replication=3

ftp_stream_buffer_size=4096

HADOOP_CLASSPATH=/contrib/capacity-scheduler/*.jar:/contrib/capacity-scheduler/*.jar

HADOOP_CLIENT_OPTS=-Xmx512m -Xmx512m

hadoop_common_configuration_version=0.23.0

HADOOP_COMMON_HOME=/opt/mapr/hadoop/hadoop-2.4.1

HADOOP_CONF_DIR=/opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop

HADOOP_DATANODE_OPTS=-Dhadoop.security.logger=ERROR,RFAS -Dhadoop.security.logger=ERROR,RFAS

HADOOP_HDFS_HOME=/opt/mapr/hadoop/hadoop-2.4.1

hadoop_http_authentication_kerberos_keytab=/home/mapr/hadoop.keytab

hadoop_http_authentication_kerberos_principal=HTTP/_HOST@LOCALHOST

hadoop_http_authentication_signature_secret=com.mapr.security.maprauth.MaprSignatureSecretFactory

hadoop_http_authentication_signature_secret_file=/home/mapr/hadoop-http-auth-signature-secret

hadoop_http_authentication_simple_anonymous_allowed=true

hadoop_http_authentication_token_validity=36000

hadoop_http_authentication_type=simple

hadoop_http_filter_initializers=org.apache.hadoop.yarn.server.webproxy.amfilter.AmFilterInitializer

hadoop_http_staticuser_user=unknown

HADOOP_IDENT_STRING=mapr

hadoop_jetty_logs_serve_aliases=true

HADOOP_JOBTRACKER_OPTS= -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider

hadoop_kerberos_kinit_command=kinit

hadoop_logfile_count=10

hadoop_logfile_size=10000000

HADOOP_MAPRED_HOME=/opt/mapr/hadoop/hadoop-2.4.1

HADOOP_NAMENODE_OPTS=-Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender

HADOOP_NFS3_OPTS=

HADOOP_OPTS= -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/opt/mapr/hadoop/hadoop-2.4.1/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/opt/mapr/hadoop/hadoop-2.4.1 -Dhadoop.id.str=mapr -Dhadoop.root.logger=INFO,console -Djava.library.path=/opt/mapr/hadoop/hadoop-2.4.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/opt/mapr/hadoop/hadoop-2.4.1/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/opt/mapr/hadoop/hadoop-2.4.1 -Dhadoop.id.str=mapr -Dhadoop.root.logger=INFO,console -Djava.library.path=/opt/mapr/hadoop/hadoop-2.4.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true

HADOOP_PID_DIR=

HADOOP_PORTMAP_OPTS=-Xmx512m -Xmx512m

HADOOP_PREFIX=/opt/mapr/hadoop/hadoop-2.4.1

hadoop_proxyuser_mapr_groups=*

hadoop_proxyuser_mapr_hosts=*

HADOOP_ROOT_LOGGER=

hadoop_rpc_protection=authentication

hadoop_rpc_socket_factory_class_default=org.apache.hadoop.net.StandardSocketFactory

HADOOP_SECONDARYNAMENODE_OPTS=-Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender

HADOOP_SECURE_DN_LOG_DIR=/

HADOOP_SECURE_DN_PID_DIR=

HADOOP_SECURE_DN_USER=

hadoop_security_authentication=SIMPLE

hadoop_security_authorization=false

hadoop_security_group_mapping_ldap_directory_search_timeout=10000

hadoop_security_group_mapping_ldap_search_attr_group_name=cn

hadoop_security_group_mapping_ldap_search_attr_member=member

hadoop_security_group_mapping_ldap_search_filter_group=(objectClass=group)

hadoop_security_group_mapping_ldap_search_filter_user=(&(objectClass=user)(sAMAccountName={0}))

hadoop_security_group_mapping_ldap_ssl=false

hadoop_security_group_mapping=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback

hadoop_security_groups_cache_secs=300

hadoop_security_groups_cache_warn_after_ms=5000

hadoop_security_instrumentation_requires_admin=false

hadoop_security_java_security_login_config_jar_path=/mapr.login.conf

hadoop_security_uid_cache_secs=14400

hadoop_ssl_client_conf=ssl-client.xml

hadoop_ssl_enabled=false

hadoop_ssl_exclude_cipher_suites=SSL_DHE_RSA_EXPORT_WITH_DES40_CBC_SHA,SSL_RSA_EXPORT_WITH_DES40_CBC_SHA,SSL_RSA_EXPORT_WITH_RC4_40_MD5

hadoop_ssl_hostname_verifier=DEFAULT

hadoop_ssl_keystores_factory_class=org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory

hadoop_ssl_require_client_cert=false

hadoop_ssl_server_conf=ssl-server.xml

HADOOP_TASKTRACKER_OPTS= -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider

hadoop_tmp_dir=/tmp/hadoop-mapr

HADOOP_TOKEN_FILE_LOCATION=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000002/container_tokens

HADOOP_TOKEN_FILE_LOCATION=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000003/container_tokens

hadoop_user_group_static_mapping_overrides=dr.who=;

hadoop_util_hash_type=murmur

hadoop_work_around_non_threadsafe_getpwuid=false

hadoop_workaround_non_threadsafe_getpwuid=false

HADOOP_YARN_HOME=/opt/mapr/hadoop/hadoop-2.4.1

HADOOP_YARN_USER=yarn

ha_failover_controller_cli_check_rpc_timeout_ms=20000

ha_failover_controller_graceful_fence_connection_retries=1

ha_failover_controller_graceful_fence_rpc_timeout_ms=5000

ha_failover_controller_new_active_rpc_timeout_ms=60000

ha_health_monitor_check_interval_ms=1000

ha_health_monitor_connect_retry_interval_ms=1000

ha_health_monitor_rpc_timeout_ms=45000

ha_health_monitor_sleep_after_disconnect_ms=1000

ha_zookeeper_acl=world:anyone:rwcda

ha_zookeeper_parent_znode=/hadoop-ha

ha_zookeeper_session_timeout_ms=5000

HOME=/home/

io_compression_codec_bzip2_library=system-native

io_compression_codecs=org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.DeflateCodec,org.apache.hadoop.io.compress.SnappyCodec

io_file_buffer_size=8192

io_mapfile_bloom_error_rate=0.005

io_mapfile_bloom_size=1048576

io_map_index_interval=128

io_map_index_skip=0

io_native_lib_available=true

io_seqfile_compress_blocksize=1000000

io_seqfile_lazydecompress=true

io_seqfile_local_dir=/tmp/hadoop-mapr/io/local

io_seqfile_sorter_recordlimit=1000000

io_serializations=org.apache.hadoop.io.serializer.WritableSerialization

io_skip_checksum_errors=false

io_sort_record_percent=0.17

ipc_client_connection_maxidletime=10000

ipc_client_connect_max_retries=10

ipc_client_connect_max_retries_on_timeouts=45

ipc_client_connect_retry_interval=1000

ipc_client_connect_timeout=20000

ipc_client_fallback_to_simple_auth_allowed=false

ipc_client_idlethreshold=4000

ipc_client_kill_max=10

ipc_client_max_connection_setup_timeout=20

ipc_client_tcpnodelay=true

ipc_server_listen_queue_size=128

ipc_server_tcpnodelay=true

JAVA_HOME=/opt/jdk1.7.0_65

JVM_PID=27349

JVM_PID=31080

LANG=en_US.UTF-8

LD_LIBRARY_PATH=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000002:/opt/mapr/hadoop/hadoop-2.4.1/lib/native

LD_LIBRARY_PATH=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000003:/opt/mapr/hadoop/hadoop-2.4.1/lib/native

LOCAL_DIRS=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017

LOG_DIRS=/opt/mapr/hadoop/hadoop-2.4.1/logs/userlogs/application_1435654568925_0017/container_1435654568925_0017_01_000002

LOG_DIRS=/opt/mapr/hadoop/hadoop-2.4.1/logs/userlogs/application_1435654568925_0017/container_1435654568925_0017_01_000003

LOGNAME=mapr

MALLOC_ARENA_MAX=4

MAPR_ECOSYSTEM_LOGIN_OPTS=-Dhadoop.login=simple -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dmapr.library.flatclass

mapred_child_java_opts=-Xmx200m

mapred_ifile_inputstream=org.apache.hadoop.mapred.MapRIFileInputStream

mapred_ifile_outputstream=org.apache.hadoop.mapred.MapRIFileOutputStream

mapred_input_format_class=org.apache.hadoop.mapred.TextInputFormat

mapred_local_mapoutput=false

mapred_mapper_class=org.apache.hadoop.streaming.PipeMapper

mapred_mapper_new_api=false

mapred_map_runner_class=org.apache.hadoop.streaming.PipeMapRunner

mapred_maxthreads_generate_mapoutput=1

mapred_maxthreads_partition_closer=1

mapred_output_format_class=org.apache.hadoop.mapred.TextOutputFormat

mapred_queue_default_acl_administer_jobs=*

mapred_reducer_new_api=false

mapreduce_am_max_attempts=2

mapreduce_app_submission_cross_platform=false

mapreduce_client_completion_pollinterval=5000

mapreduce_client_genericoptionsparser_used=true

mapreduce_client_output_filter=FAILED

mapreduce_client_progressmonitor_pollinterval=1000

mapreduce_client_submit_file_replication=10

mapreduce_cluster_acls_enabled=false

mapreduce_cluster_local_dir=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017

mapreduce_cluster_temp_dir=/tmp/hadoop-mapr/mapred/temp

mapreduce_framework_name=yarn

mapreduce_ifile_readahead_bytes=4194304

mapreduce_ifile_readahead=true

mapreduce_input_fileinputformat_inputdir=maprfs:/user/mapr/testNFS.txt

mapreduce_input_fileinputformat_list_status_num_threads=1

mapreduce_input_fileinputformat_numinputfiles=1

mapreduce_input_fileinputformat_split_minsize=0

mapreduce_job_acl_modify_job=

mapreduce_job_acl_view_job=

mapreduce_job_application_attempt_id=1

mapreduce_job_classloader=false

mapreduce_job_classloader_system_classes=java.,javax.,org.apache.commons.logging.,org.apache.log4j.,org.apache.hadoop.

mapreduce_job_committer_setup_cleanup_needed=true

mapreduce_job_complete_cancel_delegation_tokens=true

mapreduce_job_counters_max=120

mapreduce_job_dir=maprfs:/var/mapr/cluster/yarn/rm/staging/mapr/.staging/job_1435654568925_0017

mapreduce_job_end_notification_max_attempts=5

mapreduce_job_end_notification_max_retry_interval=5000

mapreduce_job_end_notification_retry_attempts=0

mapreduce_job_end_notification_retry_interval=1000

mapreduce_job_hdfs_servers=maprfs:///

mapreduce_jobhistory_address=XXX.XXX.126.13:10020

mapreduce_jobhistory_admin_acl=*

mapreduce_jobhistory_admin_address=0.0.0.0:10033

mapreduce_jobhistory_cleaner_enable=true

mapreduce_jobhistory_cleaner_interval_ms=86400000

mapreduce_jobhistory_client_thread_count=10

mapreduce_jobhistory_datestring_cache_size=200000

mapreduce_jobhistory_done_dir=maprfs:////var/mapr/cluster/yarn/rm/staging/history/done

mapreduce_jobhistory_http_policy=HTTP_ONLY

mapreduce_jobhistory_intermediate_done_dir=maprfs:////var/mapr/cluster/yarn/rm/staging/history/done_intermediate

mapreduce_jobhistory_joblist_cache_size=20000

mapreduce_jobhistory_keytab=/etc/security/keytab/jhs.service.keytab

mapreduce_jobhistory_loadedjobs_cache_size=5

mapreduce_jobhistory_max_age_ms=604800000

mapreduce_jobhistory_minicluster_fixed_ports=false

mapreduce_jobhistory_move_interval_ms=180000

mapreduce_jobhistory_move_thread_count=3

mapreduce_jobhistory_principal=jhs/_H...@REALM.TLD

mapreduce_jobhistory_recovery_enable=false

mapreduce_jobhistory_recovery_store_class=org.apache.hadoop.mapreduce.v2.hs.HistoryServerFileSystemStateStoreService

mapreduce_jobhistory_recovery_store_fs_uri=/tmp/hadoop-mapr/mapred/history/recoverystore

mapreduce_jobhistory_webapp_address=XXX.XXX.126.13:19888

mapreduce_job_id=job_1435654568925_0017

mapreduce_job_jar=/var/mapr/cluster/yarn/rm/staging/mapr/.staging/job_1435654568925_0017/job.jar

mapreduce_job_jvm_numtasks=1

mapreduce_job_local_dir=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/work

mapreduce_job_map_output_collector_class=org.apache.hadoop.mapred.MapRFsOutputBuffer

mapreduce_job_maps=2

mapreduce_job_max_split_locations=10

mapreduce_job_maxtaskfailures_per_tracker=3

mapreduce_job_name=streamjob4015687402608607386.jar

mapreduce_job_queuename=default

mapreduce_job_reduces=1

mapreduce_job_reduce_shuffle_consumer_plugin_class=org.apache.hadoop.mapreduce.task.reduce.DirectShuffle

mapreduce_job_reduce_slowstart_completedmaps=0.95

mapreduce_job_shuffle_provider_services=mapr_direct_shuffle

mapreduce_job_skiprecords=false

mapreduce_job_speculative_slownodethreshold=1.0

mapreduce_job_speculative_slowtaskthreshold=1.0

mapreduce_job_speculative_speculativecap=0.1

mapreduce_job_split_metainfo_maxsize=10000000

mapreduce_job_submithostaddress=XXX.XXX.126.13

mapreduce_job_submithostname=host-XXX-XX-126-13.openstacklocal

mapreduce_job_token_tracking_ids_enabled=false

mapreduce_jobtracker_address=local

mapreduce_jobtracker_expire_trackers_interval=600000

mapreduce_jobtracker_handler_count=10

mapreduce_jobtracker_heartbeats_in_second=100

mapreduce_jobtracker_http_address=0.0.0.0:50030

mapreduce_jobtracker_instrumentation=org.apache.hadoop.mapred.JobTrackerMetricsInst

mapreduce_jobtracker_jobhistory_block_size=3145728

mapreduce_jobtracker_jobhistory_lru_cache_size=5

mapreduce_jobtracker_jobhistory_task_numberprogresssplits=12

mapreduce_jobtracker_maxtasks_perjob=-1

mapreduce_jobtracker_persist_jobstatus_active=true

mapreduce_jobtracker_persist_jobstatus_dir=/jobtracker/jobsInfo

mapreduce_jobtracker_persist_jobstatus_hours=1

mapreduce_jobtracker_restart_recover=false

mapreduce_jobtracker_retiredjobs_cache_size=1000

mapreduce_jobtracker_staging_root_dir=/tmp/hadoop-mapr/mapred/staging

mapreduce_jobtracker_system_dir=/tmp/hadoop-mapr/mapred/system

mapreduce_jobtracker_taskcache_levels=2

mapreduce_jobtracker_taskscheduler=org.apache.hadoop.mapred.JobQueueTaskScheduler

mapreduce_jobtracker_tasktracker_maxblacklists=4

mapreduce_job_ubertask_enable=false

mapreduce_job_ubertask_maxmaps=9

mapreduce_job_ubertask_maxreduces=1

mapreduce_job_userlog_retain_hours=24

mapreduce_job_user_name=mapr

mapreduce_job_working_dir=maprfs:/user/mapr

mapreduce_local_clientfactory_class_name=org.apache.hadoop.mapred.LocalClientFactory

mapreduce_map_cpu_vcores=1

mapreduce_map_disk=0.5

mapreduce_map_env=PATH=$PATH:/usr/bin

mapreduce_map_input_file=maprfs:/user/mapr/testNFS.txt

mapreduce_map_input_length=19

mapreduce_map_input_length=20

mapreduce_map_input_start=0

mapreduce_map_input_start=19

mapreduce_map_java_opts=-Xmx900m

mapreduce_map_log_level=INFO

mapreduce_map_maxattempts=4

mapreduce_map_memory_mb=1024

mapreduce_map_output_compress_codec=org.apache.hadoop.io.compress.DefaultCodec

mapreduce_map_output_compress=false

mapreduce_map_output_key_class=org.apache.hadoop.io.Text

mapreduce_map_output_value_class=org.apache.hadoop.io.Text

mapreduce_map_skip_maxrecords=0

mapreduce_map_skip_proc_count_autoincr=true

mapreduce_map_sort_spill_percent=0.99

mapreduce_map_speculative=true

mapreduce_output_fileoutputformat_compress_codec=org.apache.hadoop.io.compress.DefaultCodec

mapreduce_output_fileoutputformat_compress=false

mapreduce_output_fileoutputformat_compress_type=RECORD

mapreduce_output_fileoutputformat_outputdir=maprfs:/user/mapr/a

mapreduce_reduce_cpu_vcores=1

mapreduce_reduce_disk=1.33

mapreduce_reduce_input_buffer_percent=0.0

mapreduce_reduce_java_opts=-Xmx2560m

mapreduce_reduce_log_level=INFO

mapreduce_reduce_markreset_buffer_percent=0.0

mapreduce_reduce_maxattempts=4

mapreduce_reduce_memory_mb=3072

mapreduce_reduce_merge_inmem_threshold=1000

mapreduce_reduce_shuffle_connect_timeout=180000

mapreduce_reduce_shuffle_input_buffer_percent=0.70

mapreduce_reduce_shuffle_memory_limit_percent=0.25

mapreduce_reduce_shuffle_merge_percent=0.66

mapreduce_reduce_shuffle_parallelcopies=12

mapreduce_reduce_shuffle_read_timeout=180000

mapreduce_reduce_shuffle_retry_delay_max_ms=60000

mapreduce_reduce_skip_maxgroups=0

mapreduce_reduce_skip_proc_count_autoincr=true

mapreduce_reduce_speculative=true

mapreduce_shuffle_connection_keep_alive_enable=false

mapreduce_shuffle_connection_keep_alive_timeout=5

mapreduce_shuffle_max_connections=0

mapreduce_shuffle_max_threads=0

mapreduce_shuffle_port=13562

mapreduce_shuffle_ssl_enabled=false

mapreduce_shuffle_ssl_file_buffer_size=65536

mapreduce_shuffle_transfer_buffer_size=131072

mapreduce_task_attempt_id=attempt_1435654568925_0017_m_000000_0

mapreduce_task_attempt_id=attempt_1435654568925_0017_m_000001_0

mapreduce_task_files_preserve_failedtasks=false

mapreduce_task_id=task_1435654568925_0017_m_000000

mapreduce_task_id=task_1435654568925_0017_m_000001

mapreduce_task_io_sort_factor=256

mapreduce_task_io_sort_mb=100

mapreduce_task_ismap=true

mapreduce_task_local_output_class=org.apache.hadoop.mapred.MapRFsOutputFile

mapreduce_task_merge_progress_records=10000

mapreduce_task_output_dir=maprfs:/user/mapr/a/_temporary/1/_temporary/attempt_1435654568925_0017_m_000000_0

mapreduce_task_output_dir=maprfs:/user/mapr/a/_temporary/1/_temporary/attempt_1435654568925_0017_m_000001_0

mapreduce_task_partition=0

mapreduce_task_partition=1

mapreduce_task_profile=false

mapreduce_task_profile_map_params=${mapreduce.task.profile.params}

mapreduce_task_profile_maps=0-2

mapreduce_task_profile_reduce_params=${mapreduce.task.profile.params}

mapreduce_task_profile_reduces=0-2

mapreduce_task_skip_start_attempts=2

mapreduce_task_timeout=600000

mapreduce_task_tmp_dir=./tmp

mapreduce_tasktracker_dns_interface=default

mapreduce_tasktracker_dns_nameserver=default

mapreduce_tasktracker_healthchecker_interval=60000

mapreduce_tasktracker_healthchecker_script_timeout=600000

mapreduce_tasktracker_http_address=0.0.0.0:50060

mapreduce_tasktracker_http_threads=40

mapreduce_tasktracker_indexcache_mb=10

mapreduce_tasktracker_instrumentation=org.apache.hadoop.mapred.TaskTrackerMetricsInst

mapreduce_tasktracker_local_dir_minspacekill=0

mapreduce_tasktracker_local_dir_minspacestart=0

mapreduce_tasktracker_map_tasks_maximum=2

mapreduce_tasktracker_outofband_heartbeat=false

mapreduce_tasktracker_reduce_tasks_maximum=2

mapreduce_tasktracker_report_address=127.0.0.1:0

mapreduce_tasktracker_taskcontroller=org.apache.hadoop.mapred.DefaultTaskController

mapreduce_tasktracker_taskmemorymanager_monitoringinterval=5000

mapreduce_tasktracker_tasks_sleeptimebeforesigkill=5000

mapreduce_task_userlog_limit_kb=0

MAPR_HBASE_CLIENT_OPTS=-Dhadoop.login=simple -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dzookeeper.sasl.client=false

MAPR_HBASE_SERVER_OPTS=-Dhadoop.login=simple -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dmapr.library.flatclass

mapr_home=/opt/mapr

mapr_host=host-XXX-XX-126-13.openstacklocal

mapr_host=host-XXX-XX-126-14.openstacklocal

mapr_localoutput_dir=output

mapr_localspill_dir=spill

mapr_localvolumes_path=/var/mapr/local

mapr_map_keyprefix_ints=1

mapr_mapred_localvolume_mount_path=/var/mapr/local/host-XXX-XX-126-13.openstacklocal/mapred

mapr_mapred_localvolume_mount_path=/var/mapr/local/host-XXX-XX-126-14.openstacklocal/mapred

mapr_mapred_localvolume_root_dir_name=nodeManager

mapr_mapred_localvolume_root_dir_path=/var/mapr/local/host-XXX-XX-126-13.openstacklocal/mapred/nodeManager

mapr_mapred_localvolume_root_dir_path=/var/mapr/local/host-XXX-XX-126-14.openstacklocal/mapred/nodeManager

map_sort_class=org.apache.hadoop.util.QuickSort

net_topology_impl=org.apache.hadoop.net.NetworkTopology

net_topology_node_switch_mapping_impl=org.apache.hadoop.net.ScriptBasedMapping

net_topology_script_number_args=100

nfs3_mountd_port=4242

nfs3_server_port=2049

NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat

NM_AUX_SERVICE_mapr_direct_shuffle=AAAAIWhvc3QtMTcyLTMwLTEyNi0xMy5vcGVuc3RhY2tsb2NhbAUAAAAIb3V0cHV0LlUAAAAOMjQ0

NM_AUX_SERVICE_mapr_direct_shuffle=AAAAIWhvc3QtMTcyLTMwLTEyNi0xNC5vcGVuc3RhY2tsb2NhbAUAAAAIb3V0cHV0LlUAAAAOMjA1

NM_AUX_SERVICE_mapreduce_shuffle=AAA0+gAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=

NM_HOST=host-XXX-XX-126-13.openstacklocal

NM_HOST=host-XXX-XX-126-14.openstacklocal

NM_HTTP_PORT=8042

NM_PORT=34902

NM_PORT=42631

_=/opt/jdk1.7.0_65/bin/java

PATH=/opt/jdk1.7.0_65/bin:/sbin:/usr/sbin:/bin:/usr/bin:/sbin:/usr/sbin:/bin:/usr/bin:/opt/mapr/warden/:/opt/mapr/lib:/opt/mapr/server:/usr/bin

PWD=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000002

PWD=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000003

rpc_metrics_quantile_enable=false

s3_blocksize=67108864

s3_bytes_per_checksum=512

s3_client_write_packet_size=65536

s3native_blocksize=67108864

s3native_bytes_per_checksum=512

s3native_client_write_packet_size=65536

s3native_replication=3

s3native_stream_buffer_size=4096

s3_replication=3

s3_stream_buffer_size=4096

SHELL=/bin/bash

SHLVL=4

STDERR_LOGFILE_ENV=/opt/mapr/hadoop/hadoop-2.4.1/logs/userlogs/application_1435654568925_0017/container_1435654568925_0017_01_000002/stderr

STDERR_LOGFILE_ENV=/opt/mapr/hadoop/hadoop-2.4.1/logs/userlogs/application_1435654568925_0017/container_1435654568925_0017_01_000003/stderr

STDOUT_LOGFILE_ENV=/opt/mapr/hadoop/hadoop-2.4.1/logs/userlogs/application_1435654568925_0017/container_1435654568925_0017_01_000002/stdout

STDOUT_LOGFILE_ENV=/opt/mapr/hadoop/hadoop-2.4.1/logs/userlogs/application_1435654568925_0017/container_1435654568925_0017_01_000003/stdout

stream_addenvironment=HADOOP_ROOT_LOGGER=

stream_map_input_writer_class=org.apache.hadoop.streaming.io.TextInputWriter

stream_map_output_reader_class=org.apache.hadoop.streaming.io.TextOutputReader

stream_map_streamprocessor=%2Fbin%2Fenv

stream_reduce_input_writer_class=org.apache.hadoop.streaming.io.TextInputWriter

stream_reduce_output_reader_class=org.apache.hadoop.streaming.io.TextOutputReader

TERM=unknown

TERM=vt100

tfile_fs_input_buffer_size=262144

tfile_fs_output_buffer_size=262144

tfile_io_chunk_size=1048576

TMPDIR=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000002/tmp

TMPDIR=/tmp/hadoop-mapr/nm-local-dir/usercache/mapr/appcache/application_1435654568925_0017/container_1435654568925_0017_01_000003/tmp

USER=mapr

XFILESEARCHPATH=/usr/dt/app-defaults/%L/Dt

yarn_acl_enable=false

yarn_admin_acl=*

yarn_am_liveness_monitor_expiry_interval_ms=600000

yarn_app_mapreduce_am_command_opts=-Xmx1024m

yarn_app_mapreduce_am_container_log_backups=0

yarn_app_mapreduce_am_container_log_limit_kb=0

yarn_app_mapreduce_am_job_committer_cancel_timeout=60000

yarn_app_mapreduce_am_job_committer_commit_window=10000

yarn_app_mapreduce_am_job_task_listener_thread_count=30

yarn_app_mapreduce_am_resource_cpu_vcores=1

yarn_app_mapreduce_am_resource_mb=1536

yarn_app_mapreduce_am_scheduler_heartbeat_interval_ms=1000

yarn_app_mapreduce_am_staging_dir=maprfs:////var/mapr/cluster/yarn/rm/staging

yarn_app_mapreduce_client_am_ipc_max_retries=3

yarn_app_mapreduce_client_am_ipc_max_retries_on_timeouts=3

yarn_app_mapreduce_client_max_retries=3

yarn_app_mapreduce_task_container_log_backups=0

yarn_client_application_client_protocol_poll_interval_ms=200

yarn_client_failover_proxy_provider=org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider

yarn_client_failover_retries=0

yarn_client_failover_retries_on_socket_timeouts=0

yarn_client_max_nodemanagers_proxies=500

yarn_client_nodemanager_client_async_thread_pool_max_size=500

YARN_CONF_DIR=/opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop

yarn_external_token_manager=com.mapr.hadoop.yarn.security.MapRTicketManager

YARN_HISTORYSERVER_OPTS= -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider

yarn_http_policy=HTTP_ONLY

YARN_IDENT_STRING=mapr

yarn_ipc_rpc_class=org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC

yarn_ipc_serializer_type=protocolbuffers

yarn_log_aggregation_enable=false

yarn_log_aggregation_retain_check_interval_seconds=-1

yarn_log_aggregation_retain_seconds=-1

YARN_LOGFILE=yarn-mapr-nodemanager-host-XXX-XX-126-13.openstacklocal.log

YARN_LOGFILE=yarn-mapr-nodemanager-host-XXX-XX-126-14.openstacklocal.log

yarn_mapr_ticket_expiration=604800000

YARN_NICENESS=0

yarn_nm_liveness_monitor_expiry_interval_ms=600000

yarn_nodemanager_address=0.0.0.0:0

yarn_nodemanager_admin_env=MALLOC_ARENA_MAX=$MALLOC_ARENA_MAX

yarn_nodemanager_aux_services_mapr_direct_shuffle_class=com.mapr.hadoop.mapred.LocalVolumeAuxService

yarn_nodemanager_aux_services_mapreduce_shuffle_class=org.apache.hadoop.mapred.ShuffleHandler

yarn_nodemanager_aux_services=mapreduce_shuffle,mapr_direct_shuffle

yarn_nodemanager_container_executor_class=org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor

yarn_nodemanager_container_manager_thread_count=20

yarn_nodemanager_container_monitor_interval_ms=3000

yarn_nodemanager_container_monitor_procfs_tree_smaps_based_rss_enabled=false

yarn_nodemanager_delete_debug_delay_sec=0

yarn_nodemanager_delete_thread_count=4

yarn_nodemanager_disk_health_checker_interval_ms=120000

yarn_nodemanager_disk_health_checker_max_disk_utilization_per_disk_percentage=100.0

yarn_nodemanager_disk_health_checker_min_free_space_per_disk_mb=0

yarn_nodemanager_disk_health_checker_min_healthy_disks=0.25

yarn_nodemanager_env_whitelist=JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,HADOOP_YARN_HOME

yarn_nodemanager_external_token_localizer=com.mapr.hadoop.yarn.nodemanager.MapRTicketLocalizer

yarn_nodemanager_health_checker_interval_ms=600000

yarn_nodemanager_health_checker_script_timeout_ms=1200000

yarn_nodemanager_hostname=0.0.0.0

yarn_nodemanager_keytab=/etc/krb5.keytab

yarn_nodemanager_linux_container_executor_cgroups_hierarchy=/hadoop-yarn

yarn_nodemanager_linux_container_executor_cgroups_mount=false

yarn_nodemanager_linux_container_executor_nonsecure_mode_local_user=nobody

yarn_nodemanager_linux_container_executor_nonsecure_mode_user_pattern=^[_.A-Za-z0-9][-@_.A-Za-z0-9]{0,255}?[$]?$

yarn_nodemanager_linux_container_executor_resources_handler_class=org.apache.hadoop.yarn.server.nodemanager.util.DefaultLCEResourcesHandler

yarn_nodemanager_local_cache_max_files_per_directory=8192

yarn_nodemanager_local_dirs=/tmp/hadoop-mapr/nm-local-dir

yarn_nodemanager_localizer_address=0.0.0.0:8040

yarn_nodemanager_localizer_cache_cleanup_interval_ms=600000

yarn_nodemanager_localizer_cache_target_size_mb=10240

yarn_nodemanager_localizer_client_thread_count=5

yarn_nodemanager_localizer_fetch_thread_count=4

yarn_nodemanager_log_aggregation_compression_type=none

yarn_nodemanager_log_dirs=${yarn.log.dir}/userlogs

yarn_nodemanager_log_retain_seconds=10800

YARN_NODEMANAGER_OPTS= -Dnodemanager.resource.memory-mb=25015 -Dnodemanager.resource.cpu-vcores=6 -Dnodemanager.resource.io-spindles=1.0 -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider

YARN_NODEMANAGER_OPTS= -Dnodemanager.resource.memory-mb=35265 -Dnodemanager.resource.cpu-vcores=6 -Dnodemanager.resource.io-spindles=1.0 -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider

yarn_nodemanager_pmem_check_enabled=true

yarn_nodemanager_process_kill_wait_ms=2000

yarn_nodemanager_remote_app_log_dir_suffix=logs

yarn_nodemanager_remote_app_log_dir=/tmp/logs

yarn_nodemanager_resource_cpu_vcores=${nodemanager.resource.cpu-vcores}

yarn_nodemanager_resource_io_spindles=${nodemanager.resource.io-spindles}

yarn_nodemanager_resourcemanager_connect_retry_interval_secs=30

yarn_nodemanager_resourcemanager_connect_wait_secs=900

yarn_nodemanager_resourcemanager_minimum_version=NONE

yarn_nodemanager_resource_memory_mb=${nodemanager.resource.memory-mb}

yarn_nodemanager_sleep_delay_before_sigkill_ms=250

yarn_nodemanager_vmem_check_enabled=false

yarn_nodemanager_vmem_pmem_ratio=2.1

yarn_nodemanager_webapp_address=0.0.0.0:8042

yarn_resourcemanager_address=0.0.0.0:8032

yarn_resourcemanager_address_rm1=XXX.XXX.126.11:8032

yarn_resourcemanager_address_rm2=XXX.XXX.126.12:8032

yarn_resourcemanager_address_rm3=XXX.XXX.126.14:8032

yarn_resourcemanager_admin_address=0.0.0.0:8033

yarn_resourcemanager_admin_address_rm1=XXX.XXX.126.11:8033

yarn_resourcemanager_admin_address_rm2=XXX.XXX.126.12:8033

yarn_resourcemanager_admin_address_rm3=XXX.XXX.126.14:8033

yarn_resourcemanager_admin_client_thread_count=1

yarn_resourcemanager_amliveliness_monitor_interval_ms=1000

yarn_resourcemanager_am_max_attempts=2

yarn_resourcemanager_application_tokens_master_key_rolling_interval_secs=86400

yarn_resourcemanager_aux_services_HSVolumeManager_class=com.mapr.hadoop.yarn.resourcemanager.RMVolumeManager

yarn_resourcemanager_aux_services=RMVolumeManager

yarn_resourcemanager_aux_services_RMVolumeManager_class=com.mapr.hadoop.yarn.resourcemanager.RMVolumeManager

yarn_resourcemanager_client_thread_count=50

yarn_resourcemanager_cluster_id=yarn-hss.fastconnect.com

yarn_resourcemanager_configuration_provider_class=org.apache.hadoop.yarn.LocalConfigurationProvider

yarn_resourcemanager_connect_max_wait_ms=900000

yarn_resourcemanager_connect_retry_interval_ms=30000

yarn_resourcemanager_container_liveness_monitor_interval_ms=600000

yarn_resourcemanager_container_tokens_master_key_rolling_interval_secs=86400

yarn_resourcemanager_delayed_delegation_token_removal_interval_ms=30000

yarn_resourcemanager_dir=/var/mapr/cluster/yarn/rm

yarn_resourcemanager_fs_state_store_retry_policy_spec=2000, 500

yarn_resourcemanager_fs_state_store_uri=/var/mapr/cluster/yarn/rm/system

yarn_resourcemanager_ha_automatic_failover_embedded=true

yarn_resourcemanager_ha_automatic_failover_enabled=true

yarn_resourcemanager_ha_automatic_failover_zk_base_path=/yarn-leader-election

yarn_resourcemanager_ha_enabled=true

yarn_resourcemanager_ha_id=rm1

yarn_resourcemanager_ha_rm_ids=rm1,rm2,rm3

yarn_resourcemanager_history_writer_multi_threaded_dispatcher_pool_size=10

yarn_resourcemanager_hostname=0.0.0.0

yarn_resourcemanager_keytab=/etc/krb5.keytab

yarn_resourcemanager_max_completed_applications=10000

yarn_resourcemanager_nm_liveness_monitor_interval_ms=1000

yarn_resourcemanager_nodemanager_minimum_version=NONE

yarn_resourcemanager_nodemanagers_heartbeat_interval_ms=1000

YARN_RESOURCEMANAGER_OPTS= -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dhadoop.login=maprsasl -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider

yarn_resourcemanager_principal=mapr

yarn_resourcemanager_recovery_enabled=true

yarn_resourcemanager_resource_tracker_address=0.0.0.0:8031

yarn_resourcemanager_resource_tracker_address_rm1=XXX.XXX.126.11:8031

yarn_resourcemanager_resource_tracker_address_rm2=XXX.XXX.126.12:8031

yarn_resourcemanager_resource_tracker_address_rm3=XXX.XXX.126.14:8031

yarn_resourcemanager_resource_tracker_client_thread_count=50

yarn_resourcemanager_scheduler_address=0.0.0.0:8030

yarn_resourcemanager_scheduler_address_rm1=XXX.XXX.126.11:8030

yarn_resourcemanager_scheduler_address_rm2=XXX.XXX.126.12:8030

yarn_resourcemanager_scheduler_address_rm3=XXX.XXX.126.14:8030

yarn_resourcemanager_scheduler_class=org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler

yarn_resourcemanager_scheduler_client_thread_count=50

yarn_resourcemanager_scheduler_monitor_enable=false

yarn_resourcemanager_scheduler_monitor_policies=org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy

yarn_resourcemanager_staging=/var/mapr/cluster/yarn/rm/staging

yarn_resourcemanager_state_store_max_completed_applications=10000

yarn_resourcemanager_store_class=org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore

yarn_resourcemanager_system=/var/mapr/cluster/yarn/rm/system

yarn_resourcemanager_webapp_address=0.0.0.0:8088

yarn_resourcemanager_webapp_address_rm1=XXX.XXX.126.11:8088

yarn_resourcemanager_webapp_address_rm2=XXX.XXX.126.12:8088

yarn_resourcemanager_webapp_address_rm3=XXX.XXX.126.14:8088

yarn_resourcemanager_webapp_https_address=0.0.0.0:8090

yarn_resourcemanager_webapp_https_address_rm1=XXX.XXX.126.11:8090

yarn_resourcemanager_webapp_https_address_rm2=XXX.XXX.126.12:8090

yarn_resourcemanager_webapp_https_address_rm3=XXX.XXX.126.14:8090

yarn_resourcemanager_zk_acl=world:anyone:rwcda

yarn_resourcemanager_zk_address=XXX.XXX.126.11:5181,XXX.XXX.126.12:5181,XXX.XXX.126.14:5181

yarn_resourcemanager_zk_num_retries=500

yarn_resourcemanager_zk_retry_interval_ms=2000

yarn_resourcemanager_zk_state_store_parent_path=/rmstore

yarn_resourcemanager_zk_timeout_ms=10000

YARN_ROOT_LOGGER=INFO,RFA

yarn_scheduler_maximum_allocation_mb=8192

yarn_scheduler_maximum_allocation_vcores=32

yarn_scheduler_minimum_allocation_mb=1024

yarn_scheduler_minimum_allocation_vcores=1

yarn_timeline_service_address=0.0.0.0:10200

yarn_timeline_service_enabled=false

yarn_timeline_service_generic_application_history_aux_services=HSVolumeManager

yarn_timeline_service_generic_application_history_enabled=false

yarn_timeline_service_generic_application_history_fs_history_store_compression_type=none

yarn_timeline_service_generic_application_history_fs_history_store_uri=/tmp/hadoop-mapr/yarn/timeline/generic-history

yarn_timeline_service_generic_application_history_store_class=org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore

yarn_timeline_service_handler_thread_count=10

yarn_timeline_service_hostname=0.0.0.0

yarn_timeline_service_leveldb_timeline_store_path=/tmp/hadoop-mapr/yarn/timeline

yarn_timeline_service_leveldb_timeline_store_read_cache_size=104857600

yarn_timeline_service_leveldb_timeline_store_start_time_read_cache_size=10000

yarn_timeline_service_leveldb_timeline_store_start_time_write_cache_size=10000

yarn_timeline_service_leveldb_timeline_store_ttl_interval_ms=300000

yarn_timeline_service_store_class=org.apache.hadoop.yarn.server.applicationhistoryservice.timeline.LeveldbTimelineStore

yarn_timeline_service_ttl_enable=true

yarn_timeline_service_ttl_ms=604800000

yarn_timeline_service_webapp_address=0.0.0.0:8188

yarn_timeline_service_webapp_https_address=0.0.0.0:8190

ZOOKEEPER_SERVER_OPTS=-Dzookeeper.sasl.serverconfig=Server_simple -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider

Antonio Piccolboni

unread,

Jul 7, 2015, 1:41:11 PM7/7/15

to rha...@googlegroups.com

This is the bit I wanted to see, thanks:

PATH=/opt/jdk1.7.0_65/bin:/sbin:/usr/sbin:/bin:/usr/bin:/sbin:/usr/sbin:/bin:/usr/bin:/opt/mapr/warden/:/opt/mapr/lib:/opt/mapr/server:/usr/bin

I think this PATH includes the directory where RScript is installed, you may want to double check, but from the experiment with env it's clear this is not an Rscript issue. The problem is that for some reason, when a cmd is invoked by streaming and is designated just as a base name, no path, it gets construed as ./env or ./Rscript, even if I don't see . (dot) on the PATH. You may want to double check that as my eyes may be at fault, but I don't see it. So we know a little more about your problem, but not enough to solve it yet. I need to research it a bit more. Keep in mind, this is a streaming problem more than an rmr2 problem. rmr2 calls Rscript and needs Rscript to be executable, and it isn't. In the end, there may be nothing that can be changed on the rmr2 side to fix it. At the same time, I would like to understand what's happening because you seem to have the configuration right and still it doesn't do what is expected.

Brunob

unread,

Jul 9, 2015, 6:00:12 AM7/9/15

to rha...@googlegroups.com, ant...@piccolboni.info

Hello Antonio,

I double checked and everything in PATH variable is good.

I think this is a Mapr problem or misconfiguration.

I tested (without full path) on cloudera and it works

hadoop jar $HADOOP_STREAMING -input <one line text file> -output <any valid path> -mapper env

I tested (without full path) on Horton HDP 2.1 and it works
If you have information about that thank you.

Regards.

...

Antonio Piccolboni

unread,

Jul 9, 2015, 3:03:55 PM7/9/15

to Brunob, rha...@googlegroups.com

You need to report this to MapR support, I think it's a bug. Thanks for doing these tests.

Bruno BOU

unread,

Oct 6, 2015, 9:23:10 AM10/6/15

to Antonio Piccolboni, rha...@googlegroups.com

Hi Antonio

After applying a Mapr patch, rmr2 works perfectly.

It was a Mapr M5 problem.
The patch is mapr-patch-4.0.1.27334.GA-34406.x86_64.rpm