|
stderr log not showing any exception's :
SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/hadoop/.versions/2.4.0-amzn-3/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/mnt/var/lib/hadoop/tmp/nm-local-dir/usercache/hadoop/filecache/46/spark-assembly-1.2.1-hadoop2.4.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 15/03/09 20:33:32 INFO yarn.ApplicationMaster: Registered signal handlers for [TERM, HUP, INT] 15/03/09 20:33:33 INFO yarn.ApplicationMaster: ApplicationAttemptId: appattempt_1425166635254_0645_000001 15/03/09 20:33:34 INFO spark.SecurityManager: Changing view acls to: hadoop 15/03/09 20:33:34 INFO spark.SecurityManager: Changing modify acls to: hadoop 15/03/09 20:33:34 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); users with modify permissions: Set(hadoop) 15/03/09 20:33:35 INFO slf4j.Slf4jLogger: Slf4jLogger started 15/03/09 20:33:35 INFO Remoting: Starting remoting 15/03/09 20:33:35 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://spark...@ip-10-166-125-72.ec2.internal:40282] 15/03/09 20:33:35 INFO util.Utils: Successfully started service 'sparkYarnAM' on port 40282. 15/03/09 20:33:35 INFO yarn.ApplicationMaster: Waiting for Spark driver to be reachable. 15/03/09 20:33:35 INFO yarn.ApplicationMaster: Driver now available: ip-10-37-194-88.ec2.internal:41514 15/03/09 20:33:35 INFO yarn.ApplicationMaster: Listen to driver: akka.tcp://spark...@ip-10-37-194-88.ec2.internal:41514/user/YarnScheduler 15/03/09 20:33:35 INFO yarn.ApplicationMaster: Add WebUI Filter. AddWebUIFilter(org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter,Map(PROXY_HOSTS -> 10.37.194.88, PROXY_URI_BASES -> http://10.37.194.88:9046/proxy/application_1425166635254_0645),/proxy/application_1425166635254_0645) 15/03/09 20:33:35 INFO client.RMProxy: Connecting to ResourceManager at /10.37.194.88:9024 15/03/09 20:33:35 INFO yarn.YarnRMClientImpl: Registering the ApplicationMaster 15/03/09 20:33:35 INFO yarn.YarnAllocationHandler: Will allocate 2 executor containers, each with 1408 MB memory including 384 MB overhead 15/03/09 20:33:35 INFO yarn.YarnAllocationHandler: Container request (host: Any, priority: 1, capability: <memory:1408, vCores:1> 15/03/09 20:33:35 INFO yarn.YarnAllocationHandler: Container request (host: Any, priority: 1, capability: <memory:1408, vCores:1> 15/03/09 20:33:35 INFO yarn.ApplicationMaster: Started progress reporter thread - sleep time : 5000 15/03/09 20:33:40 INFO impl.AMRMClientImpl: Received new token for : ip-10-166-125-72.ec2.internal:9103 15/03/09 20:33:40 INFO impl.AMRMClientImpl: Received new token for : ip-10-168-114-96.ec2.internal:9103 15/03/09 20:33:40 INFO util.RackResolver: Resolved ip-10-166-125-72.ec2.internal to /default-rack 15/03/09 20:33:40 INFO util.RackResolver: Resolved ip-10-168-114-96.ec2.internal to /default-rack 15/03/09 20:33:40 INFO yarn.YarnAllocationHandler: Launching container container_1425166635254_0645_01_000002 for on host ip-10-166-125-72.ec2.internal 15/03/09 20:33:40 INFO yarn.YarnAllocationHandler: Launching ExecutorRunnable. driverUrl: akka.tcp://spark...@ip-10-37-194-88.ec2.internal:41514/user/CoarseGrainedScheduler, executorHostname: ip-10-166-125-72.ec2.internal 15/03/09 20:33:40 INFO yarn.YarnAllocationHandler: Launching container container_1425166635254_0645_01_000003 for on host ip-10-168-114-96.ec2.internal 15/03/09 20:33:40 INFO yarn.YarnAllocationHandler: Launching ExecutorRunnable. driverUrl: akka.tcp://spark...@ip-10-37-194-88.ec2.internal:41514/user/CoarseGrainedScheduler, executorHostname: ip-10-168-114-96.ec2.internal 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Starting Executor Container 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Starting Executor Container 15/03/09 20:33:40 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 15/03/09 20:33:40 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Preparing Local resources 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Preparing Local resources 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Prepared Local resources Map(_spark_.jar -> resource { scheme: "hdfs" host: "ec2-54-221-177-108.compute-1.amazonaws.com" port: 9000 file: "/user/hadoop/.sparkStaging/application_1425166635254_0645/spark-assembly-1.2.1-hadoop2.4.0.jar" }
size: 127193956 timestamp: 1425933210291 type: FILE visibility: PRIVATE, wordcount.R -> resource { scheme: "hdfs" host: "ec2-54-221-177-108.compute-1.amazonaws.com" port: 9000 file: "/user/hadoop/.sparkStaging/application_1425166635254_0645/wordcount.R" }
size: 575 timestamp: 1425933210363 type: FILE visibility: PRIVATE) 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Prepared Local resources Map(_spark_.jar -> resource { scheme: "hdfs" host: "ec2-54-221-177-108.compute-1.amazonaws.com" port: 9000 file: "/user/hadoop/.sparkStaging/application_1425166635254_0645/spark-assembly-1.2.1-hadoop2.4.0.jar" }
size: 127193956 timestamp: 1425933210291 type: FILE visibility: PRIVATE, wordcount.R -> resource { scheme: "hdfs" host: "ec2-54-221-177-108.compute-1.amazonaws.com" port: 9000 file: "/user/hadoop/.sparkStaging/application_1425166635254_0645/wordcount.R" }
size: 575 timestamp: 1425933210363 type: FILE visibility: PRIVATE) 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> /home/hadoop/spark/conf:/home/hadoop/conf:/home/hadoop/spark/classpath/emr/:/home/hadoop/spark/classpath/emrfs/:/home/hadoop/share/hadoop/common/lib/:/home/hadoop/share/hadoop/common/lib/hadoop-lzo.jar:$PWD:$PWD/_spark.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/share/hadoop/common/:$HADOOP_COMMON_HOME/share/hadoop/common/lib/:$HADOOP_HDFS_HOME/share/hadoop/hdfs/:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/:$HADOOP_YARN_HOME/share/hadoop/yarn/:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/:/usr/share/aws/emr/emrfs/lib/:/usr/share/aws/emr/lib/:/usr/share/aws/emr/auxlib/:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/:/usr/share/aws/emr/emrfs/lib/:/usr/share/aws/emr/lib/:/usr/share/aws/emr/auxlib/:$PWD/app.jar:$PWD/, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1425166635254_0645/, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 127193956,575, SPARK_USER -> hadoop, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1425933210291,1425933210363, LD_LIBRARY_PATH -> $LD_LIBRARY_PATH:/usr/lib64/R/lib:/usr/local/lib64:/usr/lib64:/home/hadoop/lib/native:/usr/lib64:/usr/local/cuda/lib64:/usr/local/cuda/lib:, SPARK_YARN_CACHE_FILES -> hdfs://ec2-54-221-177-108.compute-1.amazonaws.com:9000/user/hadoop/.sparkStaging/application_1425166635254_0645/spark-assembly-1.2.1-hadoop2.4.0.jar#spark_.jar,hdfs://ec2-54-221-177-108.compute-1.amazonaws.com:9000/user/hadoop/.sparkStaging/application_1425166635254_0645/wordcount.R#wordcount.R) 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> /home/hadoop/spark/conf:/home/hadoop/conf:/home/hadoop/spark/classpath/emr/:/home/hadoop/spark/classpath/emrfs/:/home/hadoop/share/hadoop/common/lib/:/home/hadoop/share/hadoop/common/lib/hadoop-lzo.jar:$PWD:$PWD/_spark.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/share/hadoop/common/:$HADOOP_COMMON_HOME/share/hadoop/common/lib/:$HADOOP_HDFS_HOME/share/hadoop/hdfs/:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/:$HADOOP_YARN_HOME/share/hadoop/yarn/:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/:/usr/share/aws/emr/emrfs/lib/:/usr/share/aws/emr/lib/:/usr/share/aws/emr/auxlib/:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/:/usr/share/aws/emr/emrfs/lib/:/usr/share/aws/emr/lib/:/usr/share/aws/emr/auxlib/:$PWD/app.jar:$PWD/, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1425166635254_0645/, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 127193956,575, SPARK_USER -> hadoop, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1425933210291,1425933210363, LD_LIBRARY_PATH -> $LD_LIBRARY_PATH:/usr/lib64/R/lib:/usr/local/lib64:/usr/lib64:/home/hadoop/lib/native:/usr/lib64:/usr/local/cuda/lib64:/usr/local/cuda/lib:, SPARK_YARN_CACHE_FILES -> hdfs://ec2-54-221-177-108.compute-1.amazonaws.com:9000/user/hadoop/.sparkStaging/application_1425166635254_0645/spark-assembly-1.2.1-hadoop2.4.0.jar#spark_.jar,hdfs://ec2-54-221-177-108.compute-1.amazonaws.com:9000/user/hadoop/.sparkStaging/application_1425166635254_0645/wordcount.R#wordcount.R) 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms1024m -Xmx1024m , -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:MaxHeapFreeRatio=70, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.driver.port=41514', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, akka.tcp://spark...@ip-10-37-194-88.ec2.internal:41514/user/CoarseGrainedScheduler, 2, ip-10-168-114-96.ec2.internal, 1, application_1425166635254_0645, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) 15/03/09 20:33:40 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms1024m -Xmx1024m , -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:MaxHeapFreeRatio=70, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.driver.port=41514', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, akka.tcp://spark...@ip-10-37-194-88.ec2.internal:41514/user/CoarseGrainedScheduler, 1, ip-10-166-125-72.ec2.internal, 1, application_1425166635254_0645, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) 15/03/09 20:33:40 INFO impl.ContainerManagementProtocolProxy: Opening proxy : ip-10-168-114-96.ec2.internal:9103 15/03/09 20:33:40 INFO impl.ContainerManagementProtocolProxy: Opening proxy : ip-10-166-125-72.ec2.internal:9103 15/03/09 20:34:42 INFO yarn.ApplicationMaster: Driver terminated or disconnected! Shutting down. Disassociated [akka.tcp://spark...@ip-10-166-125-72.ec2.internal:40282] -> [akka.tcp://spark...@ip-10-37-194-88.ec2.internal:41514] 15/03/09 20:34:42 INFO yarn.ApplicationMaster: Final app status: SUCCEEDED, exitCode: 0 15/03/09 20:34:42 INFO yarn.ApplicationMaster: Unregistering ApplicationMaster with SUCCEEDED 15/03/09 20:34:42 INFO impl.AMRMClientImpl: Waiting for application to be successfully unregistered. 15/03/09 20:34:42 INFO yarn.ApplicationMaster: Deleting staging directory .sparkStaging/application_1425166635254_0645
|