mvn package error

436 views
Skip to first unread message

Bin Wang

unread,
Jul 10, 2013, 8:08:54 PM7/10/13
to storm...@googlegroups.com
JDK 7.0_25
i meet below error when i run "mvn package"

i installed apache hadoop-2.0.4-alpha on the same machine and started hdfs and yarn when i build yarn-storm, don't know whether this is required. If it's required, what should we do before run "mvn package"
Thanks!
 

[INFO] Scanning for projects...
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building storm-yarn 1.0-alpha
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ storm-yarn ---
[debug] execute contextualize
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] Copying 1 resource
[INFO] 
[INFO] --- maven-compiler-plugin:3.0:compile (default-compile) @ storm-yarn ---
[INFO] Changes detected - recompiling the module!
[WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent!
[INFO] Compiling 11 source files to /root/workspace/storm-yarn/target/classes
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ storm-yarn ---
[debug] execute contextualize
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] Copying 1 resource
[INFO] 
[INFO] --- maven-compiler-plugin:3.0:testCompile (default-testCompile) @ storm-yarn ---
[INFO] Changes detected - recompiling the module!
[WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent!
[INFO] Compiling 5 source files to /root/workspace/storm-yarn/target/test-classes
[INFO] 
[INFO] --- maven-jar-plugin:2.4:jar (default) @ storm-yarn ---
[INFO] Building jar: /root/workspace/storm-yarn/target/storm-yarn-1.0-alpha.jar
[INFO] 
[INFO] --- maven-surefire-plugin:2.10:test (default-test) @ storm-yarn ---
[INFO] Surefire report directory: /root/workspace/storm-yarn/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running com.yahoo.storm.yarn.TestIntegration
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/root/.m2/repository/ch/qos/logback/logback-classic/1.0.6/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
17:01:43,805 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
17:01:43,805 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
17:01:43,805 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [file:/root/workspace/storm-yarn/target/test-classes/logback.xml]
17:01:43,806 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs multiple times on the classpath.
17:01:43,806 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs at [file:/root/workspace/storm-yarn/target/test-classes/logback.xml]
17:01:43,806 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs at [jar:file:/root/.m2/repository/storm/storm-console-logging/0.9.0-wip17/storm-console-logging-0.9.0-wip17.jar!/logback.xml]
17:01:43,908 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
17:01:43,912 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
17:01:43,946 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
17:01:44,023 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO
17:01:44,024 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
17:01:44,025 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
17:01:44,026 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4ab6d2e5 - Registering current configuration as safe fallback point
17:01:43,805 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
17:01:43,805 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
17:01:43,805 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [file:/root/workspace/storm-yarn/target/test-classes/logback.xml]
17:01:43,806 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs multiple times on the classpath.
17:01:43,806 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs at [file:/root/workspace/storm-yarn/target/test-classes/logback.xml]
17:01:43,806 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs at [jar:file:/root/.m2/repository/storm/storm-console-logging/0.9.0-wip17/storm-console-logging-0.9.0-wip17.jar!/logback.xml]
17:01:43,908 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
17:01:43,912 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
17:01:43,946 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
17:01:44,023 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO
17:01:44,024 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
17:01:44,025 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
17:01:44,026 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4ab6d2e5 - Registering current configuration as safe fallback point

SLF4J: Actual binding is of type [ch.qos.logback.classic.selector.DefaultContextSelector]
17:01:44.035 [main] INFO  c.yahoo.storm.yarn.EmbeddedZKServer - Starting up embedded Zookeeper server
17:01:44.055 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:zookeeper.version=3.4.2-1221870, built on 12/21/2011 20:46 GMT
17:01:44.056 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:host.name=cetas-vm
17:01:44.056 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:java.version=1.7.0_25
17:01:44.056 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:java.vendor=Oracle Corporation
17:01:44.056 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:java.home=/jdk1.7.0_25/jre
17:01:44.056 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:java.class.path=/root/workspace/storm-yarn/target/test-classes:/root/workspace/storm-yarn/target/classes:/root/.m2/repository/storm/storm/0.9.0-wip17/storm-0.9.0-wip17.jar:/root/.m2/repository/storm/storm-console-logging/0.9.0-wip17/storm-console-logging-0.9.0-wip17.jar:/root/.m2/repository/storm/storm-core/0.9.0-wip17/storm-core-0.9.0-wip17.jar:/root/.m2/repository/org/clojure/clojure/1.4.0/clojure-1.4.0.jar:/root/.m2/repository/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar:/root/.m2/repository/clj-time/clj-time/0.4.1/clj-time-0.4.1.jar:/root/.m2/repository/joda-time/joda-time/2.0/joda-time-2.0.jar:/root/.m2/repository/com/netflix/curator/curator-framework/1.0.1/curator-framework-1.0.1.jar:/root/.m2/repository/com/netflix/curator/curator-client/1.0.1/curator-client-1.0.1.jar:/root/.m2/repository/backtype/jzmq/2.1.0/jzmq-2.1.0.jar:/root/.m2/repository/com/googlecode/json-simple/json-simple/1.1/json-simple-1.1.jar:/root/.m2/repository/compojure/compojure/1.1.3/compojure-1.1.3.jar:/root/.m2/repository/org/clojure/core.incubator/0.1.0/core.incubator-0.1.0.jar:/root/.m2/repository/org/clojure/tools.macro/0.1.0/tools.macro-0.1.0.jar:/root/.m2/repository/clout/clout/1.0.1/clout-1.0.1.jar:/root/.m2/repository/ring/ring-core/1.1.5/ring-core-1.1.5.jar:/root/.m2/repository/commons-fileupload/commons-fileupload/1.2.1/commons-fileupload-1.2.1.jar:/root/.m2/repository/hiccup/hiccup/0.3.6/hiccup-0.3.6.jar:/root/.m2/repository/ring/ring-devel/0.3.11/ring-devel-0.3.11.jar:/root/.m2/repository/clj-stacktrace/clj-stacktrace/0.2.2/clj-stacktrace-0.2.2.jar:/root/.m2/repository/ring/ring-jetty-adapter/0.3.11/ring-jetty-adapter-0.3.11.jar:/root/.m2/repository/ring/ring-servlet/0.3.11/ring-servlet-0.3.11.jar:/root/.m2/repository/org/clojure/tools.logging/0.2.3/tools.logging-0.2.3.jar:/root/.m2/repository/org/clojure/math.numeric-tower/0.0.1/math.numeric-tower-0.0.1.jar:/root/.m2/repository/storm/carbonite/1.5.0/carbonite-1.5.0.jar:/root/.m2/repository/com/esotericsoftware/kryo/kryo/2.17/kryo-2.17.jar:/root/.m2/repository/com/esotericsoftware/reflectasm/reflectasm/1.07/reflectasm-1.07-shaded.jar:/root/.m2/repository/org/ow2/asm/asm/4.0/asm-4.0.jar:/root/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/root/.m2/repository/org/objenesis/objenesis/1.2/objenesis-1.2.jar:/root/.m2/repository/org/yaml/snakeyaml/1.9/snakeyaml-1.9.jar:/root/.m2/repository/storm/tools.cli/0.2.2/tools.cli-0.2.2.jar:/root/.m2/repository/com/googlecode/disruptor/disruptor/2.10.1/disruptor-2.10.1.jar:/root/.m2/repository/storm/jgrapht/0.8.3/jgrapht-0.8.3.jar:/root/.m2/repository/ch/qos/logback/logback-classic/1.0.6/logback-classic-1.0.6.jar:/root/.m2/repository/ch/qos/logback/logback-core/1.0.6/logback-core-1.0.6.jar:/root/.m2/repository/storm/libthrift7/0.7.0/libthrift7-0.7.0.jar:/root/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar:/root/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/root/.m2/repository/org/apache/httpcomponents/httpclient/4.0.1/httpclient-4.0.1.jar:/root/.m2/repository/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar:/root/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.2/jcl-over-slf4j-1.7.2.jar:/root/.m2/repository/org/slf4j/slf4j-api/1.7.2/slf4j-api-1.7.2.jar:/root/.m2/repository/commons-logging/commons-logging/99-empty/commons-logging-99-empty.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-server-tests/2.0.4-alpha/hadoop-yarn-server-tests-2.0.4-alpha-tests.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.0.4-alpha/hadoop-yarn-server-common-2.0.4-alpha.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-server-nodemanager/2.0.4-alpha/hadoop-yarn-server-nodemanager-2.0.4-alpha.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-server-resourcemanager/2.0.4-alpha/hadoop-yarn-server-resourcemanager-2.0.4-alpha.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-server-web-proxy/2.0.4-alpha/hadoop-yarn-server-web-proxy-2.0.4-alpha.jar:/root/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar:/root/.m2/repository/org/apache/hadoop/hadoop-annotations/2.0.4-alpha/hadoop-annotations-2.0.4-alpha.jar:/jdk1.7.0_25/jre/../lib/tools.jar:/root/.m2/repository/com/google/inject/extensions/guice-servlet/3.0/guice-servlet-3.0.jar:/root/.m2/repository/io/netty/netty/3.5.11.Final/netty-3.5.11.Final.jar:/root/.m2/repository/com/google/protobuf/protobuf-java/2.4.0a/protobuf-java-2.4.0a.jar:/root/.m2/repository/commons-io/commons-io/2.1/commons-io-2.1.jar:/root/.m2/repository/com/google/inject/guice/3.0/guice-3.0.jar:/root/.m2/repository/javax/inject/javax.inject/1/javax.inject-1.jar:/root/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/root/.m2/repository/com/sun/jersey/jersey-test-framework/jersey-test-framework-grizzly2/1.8/jersey-test-framework-grizzly2-1.8.jar:/root/.m2/repository/com/sun/jersey/jersey-test-framework/jersey-test-framework-core/1.8/jersey-test-framework-core-1.8.jar:/root/.m2/repository/org/glassfish/javax.servlet/3.0/javax.servlet-3.0.jar:/root/.m2/repository/com/sun/jersey/jersey-client/1.8/jersey-client-1.8.jar:/root/.m2/repository/com/sun/jersey/jersey-grizzly2/1.8/jersey-grizzly2-1.8.jar:/root/.m2/repository/org/glassfish/grizzly/grizzly-http/2.1.1/grizzly-http-2.1.1.jar:/root/.m2/repository/org/glassfish/grizzly/grizzly-framework/2.1.1/grizzly-framework-2.1.1.jar:/root/.m2/repository/org/glassfish/gmbal/gmbal-api-only/3.0.0-b023/gmbal-api-only-3.0.0-b023.jar:/root/.m2/repository/org/glassfish/external/management-api/3.0.0-b012/management-api-3.0.0-b012.jar:/root/.m2/repository/org/glassfish/grizzly/grizzly-http-server/2.1.1/grizzly-http-server-2.1.1.jar:/root/.m2/repository/org/glassfish/grizzly/grizzly-rcm/2.1.1/grizzly-rcm-2.1.1.jar:/root/.m2/repository/org/glassfish/grizzly/grizzly-http-servlet/2.1.1/grizzly-http-servlet-2.1.1.jar:/root/.m2/repository/org/glassfish/grizzly/grizzly-framework/2.1.1/grizzly-framework-2.1.1-tests.jar:/root/.m2/repository/com/sun/jersey/jersey-server/1.8/jersey-server-1.8.jar:/root/.m2/repository/asm/asm/3.1/asm-3.1.jar:/root/.m2/repository/com/sun/jersey/jersey-json/1.8/jersey-json-1.8.jar:/root/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/root/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/root/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/root/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/root/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/root/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.7.1/jackson-jaxrs-1.7.1.jar:/root/.m2/repository/org/codehaus/jackson/jackson-xc/1.7.1/jackson-xc-1.7.1.jar:/root/.m2/repository/com/sun/jersey/contribs/jersey-guice/1.8/jersey-guice-1.8.jar:/root/.m2/repository/org/apache/hadoop/hadoop-common/2.0.4-alpha/hadoop-common-2.0.4-alpha.jar:/root/.m2/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar:/root/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/root/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/root/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar:/root/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/root/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/root/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar:/root/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/root/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/root/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/root/.m2/repository/com/sun/jersey/jersey-core/1.8/jersey-core-1.8.jar:/root/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/root/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/root/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/root/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/root/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/root/.m2/repository/net/java/dev/jets3t/jets3t/0.6.1/jets3t-0.6.1.jar:/root/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/root/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/root/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/root/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/root/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/root/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.8.8/jackson-core-asl-1.8.8.jar:/root/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/root/.m2/repository/org/apache/avro/avro/1.5.3/avro-1.5.3.jar:/root/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/root/.m2/repository/org/xerial/snappy/snappy-java/1.0.3.2/snappy-java-1.0.3.2.jar:/root/.m2/repository/net/sf/kosmosfs/kfs/0.3/kfs-0.3.jar:/root/.m2/repository/org/apache/hadoop/hadoop-auth/2.0.4-alpha/hadoop-auth-2.0.4-alpha.jar:/root/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/root/.m2/repository/org/apache/zookeeper/zookeeper/3.4.2/zookeeper-3.4.2.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.0.4-alpha/hadoop-yarn-client-2.0.4-alpha.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.0.4-alpha/hadoop-yarn-api-2.0.4-alpha.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.0.4-alpha/hadoop-yarn-common-2.0.4-alpha.jar:/root/.m2/repository/junit/junit/4.10/junit-4.10.jar:/root/.m2/repository/org/hamcrest/hamcrest-core/1.1/hamcrest-core-1.1.jar:/root/.m2/repository/org/mockito/mockito-all/1.9.5/mockito-all-1.9.5.jar:conf:
17:01:44.059 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
17:01:44.059 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:java.io.tmpdir=/tmp
17:01:44.059 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:java.compiler=<NA>
17:01:44.059 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:os.name=Linux
17:01:44.060 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:os.arch=amd64
17:01:44.060 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:os.version=2.6.32-279.el6.x86_64
17:01:44.060 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:user.name=root
17:01:44.061 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:user.home=/root
17:01:44.061 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Server environment:user.dir=/root/workspace/storm-yarn
17:01:44.093 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir ./target/zookeeper.data/version-2 snapdir ./target/zookeeper.data/version-2
17:01:44.128 [main] INFO  o.a.z.server.NIOServerCnxnFactory - binding to port 0.0.0.0/0.0.0.0:60000
17:01:44.129 [main] INFO  c.yahoo.storm.yarn.EmbeddedZKServer - Zookeeper port allocated:60000
17:01:44.134 [main] INFO  o.a.z.s.persistence.FileTxnSnapLog - Snapshotting: 0
17:01:44.228 [main] INFO  com.yahoo.storm.yarn.TestIntegration - Starting up MiniYARN cluster
17:01:44.529 [main] WARN  o.a.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17:01:44.708 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper is inited.
17:01:44.709 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.MiniYARNCluster$NodeManagerWrapper_0 is inited.
17:01:44.709 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.MiniYARNCluster$NodeManagerWrapper_1 is inited.
17:01:44.709 [main] INFO  o.a.h.yarn.service.AbstractService - Service:com.yahoo.storm.yarn.TestIntegration is inited.
17:01:44.929 [main] INFO  o.a.h.y.s.r.s.ApplicationTokenSecretManager - Rolling master-key for application-tokens
17:01:44.949 [main] INFO  o.a.h.y.s.r.s.RMContainerTokenSecretManager - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
17:01:44.950 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is inited.
17:01:44.951 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
17:01:44.951 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is started.
17:01:44.956 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
17:01:44.956 [main] INFO  o.a.h.y.s.r.ResourceManager - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
17:01:45.052 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
17:01:45.053 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
17:01:45.054 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
17:01:45.055 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
17:01:45.218 [main] INFO  o.a.h.y.s.r.s.capacity.ParentQueue - root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:*
17:01:45.219 [main] INFO  o.a.h.y.s.r.s.capacity.ParentQueue - Initialized parent-queue root name=root, fullname=root
17:01:45.228 [main] INFO  o.a.h.y.s.r.s.capacity.LeafQueue - Initializing default
capacity = 1.0 [= (float) configuredCapacity / 100 ]
asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]
maxCapacity = 1.0 [= configuredMaxCapacity ]
absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]
userLimit = 100 [= configuredUserLimit ]
userLimitFactor = 1.0 [= configuredUserLimitFactor ]
maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]
maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]
maxActiveApplications = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) * maxAMResourcePerQueuePercent * absoluteMaxCapacity),1) ]
maxActiveAppsUsingAbsCap = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) *maxAMResourcePercent * absoluteCapacity),1) ]
maxActiveApplicationsPerUser = 1 [= max((int)(maxActiveApplications * (userLimit / 100.0f) * userLimitFactor),1) ]
usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]
absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]
maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]
minimumAllocationFactor = 0.75 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]
numContainers = 0 [= currentNumContainers ]
state = RUNNING [= configuredState ]
acls = ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:* [= configuredAcls ]

17:01:45.228 [main] INFO  o.a.h.y.s.r.s.c.CapacityScheduler - Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0
17:01:45.229 [main] INFO  o.a.h.y.s.r.s.c.CapacityScheduler - Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
17:01:45.229 [main] INFO  o.a.h.y.s.r.s.c.CapacityScheduler - Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
17:01:45.229 [main] INFO  o.a.h.y.s.r.s.c.CapacityScheduler - Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator, minimumAllocation=<<memory:512, vCores:1>>, maximumAllocation=<<memory:2048, vCores:1>>
17:01:45.245 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
17:01:45.255 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
17:01:45.258 [main] INFO  o.a.h.y.s.resourcemanager.RMNMInfo - Registered RMNMInfo MBean
17:01:45.259 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is inited.
17:01:45.259 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer is inited.
17:01:45.259 [main] INFO  o.a.h.yarn.service.AbstractService - Service:AMLivelinessMonitor is inited.
17:01:45.259 [main] INFO  o.a.h.yarn.service.AbstractService - Service:AMLivelinessMonitor is inited.
17:01:45.259 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer is inited.
17:01:45.260 [main] INFO  o.apache.hadoop.util.HostsFileReader - Refreshing hosts (include/exclude) list
17:01:45.261 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is inited.
17:01:45.261 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher is inited.
17:01:45.261 [main] INFO  o.a.h.yarn.service.AbstractService - Service:NMLivelinessMonitor is inited.
17:01:45.268 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService is inited.
17:01:45.269 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService is inited.
17:01:45.269 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ClientRMService is inited.
17:01:45.269 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.AdminService is inited.
17:01:45.270 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher is inited.
17:01:45.270 [main] INFO  o.a.h.yarn.service.AbstractService - Service:ResourceManager is inited.
17:01:45.271 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - Waiting for RM to start...
17:01:45.271 [Thread-5] INFO  o.a.h.y.s.r.s.RMContainerTokenSecretManager - Rolling master-key for container-tokens
17:01:45.271 [Timer-0] INFO  o.a.h.y.s.r.s.ApplicationTokenSecretManager - Rolling master-key for application-tokens
17:01:45.355 [Thread-5] INFO  org.mortbay.log - Logging to Logger[org.mortbay.log] via org.mortbay.log.Slf4jLog
17:01:45.417 [Thread-5] INFO  org.apache.hadoop.http.HttpServer - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
17:01:45.420 [Thread-5] INFO  org.apache.hadoop.http.HttpServer - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
17:01:45.420 [Thread-5] INFO  org.apache.hadoop.http.HttpServer - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
17:01:45.428 [Thread-5] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /cluster
17:01:45.435 [Thread-5] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /cluster/*
17:01:45.435 [Thread-5] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /ws
17:01:45.436 [Thread-5] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /ws/*
17:01:45.437 [Thread-5] INFO  org.apache.hadoop.http.HttpServer - Added global filter 'guice' (class=com.google.inject.servlet.GuiceFilter)
17:01:45.438 [Thread-5] INFO  org.apache.hadoop.http.HttpServer - Jetty bound to port 40492
17:01:45.438 [Thread-5] INFO  org.mortbay.log - jetty-6.1.26
17:01:45.478 [Thread-5] INFO  org.mortbay.log - Extract jar:file:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.0.4-alpha/hadoop-yarn-common-2.0.4-alpha.jar!/webapps/cluster to /tmp/Jetty_cetas.vm_40492_cluster____nfn5dd/webapp
17:01:45.641 [Thread-5] INFO  org.mortbay.log - Started SelectChannelConnector@cetas-vm:40492
17:01:45.642 [Thread-5] INFO  o.apache.hadoop.yarn.webapp.WebApps - Web app /cluster started at 40492
17:01:46.034 [Thread-5] INFO  o.apache.hadoop.yarn.webapp.WebApps - Registered webapp guice modules
17:01:46.064 [Thread-5] WARN  o.a.h.metrics2.impl.MetricsConfig - Cannot locate configuration: tried hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties
17:01:46.080 [Thread-5] INFO  o.a.h.m.impl.MetricsSystemImpl - Scheduled snapshot period at 10 second(s).
17:01:46.080 [Thread-5] INFO  o.a.h.m.impl.MetricsSystemImpl - ResourceManager metrics system started
17:01:46.094 [Thread-5] INFO  o.a.h.s.t.d.AbstractDelegationTokenSecretManager - Updating the current master key for generating delegation tokens
17:01:46.096 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is started.
17:01:46.097 [Thread[Thread-11,5,main]] INFO  o.a.h.s.t.d.AbstractDelegationTokenSecretManager - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
17:01:46.097 [Thread[Thread-11,5,main]] INFO  o.a.h.s.t.d.AbstractDelegationTokenSecretManager - Updating the current master key for generating delegation tokens
17:01:46.097 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer is started.
17:01:46.098 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:AMLivelinessMonitor is started.
17:01:46.098 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:AMLivelinessMonitor is started.
17:01:46.098 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer is started.
17:01:46.099 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is started.
17:01:46.099 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher is started.
17:01:46.099 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:NMLivelinessMonitor is started.
17:01:46.099 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService is started.
17:01:46.129 [Socket Reader #1 for port 51462] INFO  org.apache.hadoop.ipc.Server - Starting Socket Reader #1 for port 51462
17:01:46.141 [Thread-5] INFO  o.a.h.y.f.i.p.RpcServerFactoryPBImpl - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
17:01:46.142 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - IPC Server Responder: starting
17:01:46.143 [IPC Server listener on 51462] INFO  org.apache.hadoop.ipc.Server - IPC Server listener on 51462: starting
17:01:46.175 [Socket Reader #1 for port 43008] INFO  org.apache.hadoop.ipc.Server - Starting Socket Reader #1 for port 43008
17:01:46.185 [Thread-5] INFO  o.a.h.y.f.i.p.RpcServerFactoryPBImpl - Adding protocol org.apache.hadoop.yarn.api.AMRMProtocolPB to the server
17:01:46.186 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - IPC Server Responder: starting
17:01:46.186 [IPC Server listener on 43008] INFO  org.apache.hadoop.ipc.Server - IPC Server listener on 43008: starting
17:01:46.236 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService is started.
17:01:46.258 [Socket Reader #1 for port 42932] INFO  org.apache.hadoop.ipc.Server - Starting Socket Reader #1 for port 42932
17:01:46.261 [Thread-5] INFO  o.a.h.y.f.i.p.RpcServerFactoryPBImpl - Adding protocol org.apache.hadoop.yarn.api.ClientRMProtocolPB to the server
17:01:46.261 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - IPC Server Responder: starting
17:01:46.262 [IPC Server listener on 42932] INFO  org.apache.hadoop.ipc.Server - IPC Server listener on 42932: starting
17:01:46.278 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ClientRMService is started.
17:01:46.292 [Socket Reader #1 for port 39267] INFO  org.apache.hadoop.ipc.Server - Starting Socket Reader #1 for port 39267
17:01:46.295 [Thread-5] INFO  o.a.h.y.f.i.p.RpcServerFactoryPBImpl - Adding protocol org.apache.hadoop.yarn.api.RMAdminProtocolPB to the server
17:01:46.296 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - IPC Server Responder: starting
17:01:46.296 [IPC Server listener on 39267] INFO  org.apache.hadoop.ipc.Server - IPC Server listener on 39267: starting
17:01:46.297 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.AdminService is started.
17:01:46.297 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher is started.
17:01:46.297 [Thread-5] INFO  o.a.h.yarn.service.AbstractService - Service:ResourceManager is started.
17:01:46.771 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper is started.
17:01:46.771 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - MiniYARN ResourceManager address: cetas-vm:42932
17:01:46.771 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - MiniYARN ResourceManager web address: cetas-vm:40492
17:01:46.771 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - Created localDir in /root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-localDir-nm-0_0
17:01:46.771 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - Created logDir in /root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-logDir-nm-0_0
17:01:46.772 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - Starting NM: 0
17:01:46.802 [main] INFO  o.a.h.y.s.n.ContainerExecutor - setsid exited with exit code 0
17:01:46.857 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
17:01:46.858 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
17:01:46.858 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
17:01:46.859 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
17:01:46.859 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
17:01:46.860 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
17:01:46.861 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
17:01:46.862 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
17:01:46.862 [main] INFO  o.a.h.m.impl.MetricsSystemImpl - NodeManager metrics system started (again)
17:01:46.862 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is inited.
17:01:46.866 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService is inited.
17:01:46.881 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerService is inited.
17:01:46.881 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl is inited.
17:01:46.882 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
17:01:46.898 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
17:01:46.899 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker is inited.
17:01:46.899 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService is inited.
17:01:46.899 [main] INFO  o.a.h.yarn.service.AbstractService - Service:containers-launcher is inited.
17:01:46.899 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices is inited.
17:01:46.908 [main] INFO  o.a.h.y.s.n.c.m.ContainersMonitorImpl -  Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@19d81df3
17:01:46.908 [main] INFO  o.a.h.y.s.n.c.m.ContainersMonitorImpl -  Using ResourceCalculatorProcessTree : null
17:01:46.908 [main] INFO  o.a.h.y.s.n.c.m.ContainersMonitorImpl - Physical memory check enabled: true
17:01:46.908 [main] INFO  o.a.h.y.s.n.c.m.ContainersMonitorImpl - Virtual memory check enabled: true
17:01:46.912 [main] WARN  o.a.h.y.s.n.c.m.ContainersMonitorImpl - NodeManager configured with 4 G physical memory allocated to containers, which is more than 80% of the total physical memory available (4.2 G). Thrashing might happen.
17:01:46.912 [main] INFO  o.a.h.yarn.service.AbstractService - Service:containers-monitor is inited.
17:01:46.912 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is inited.
17:01:46.913 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler is inited.
17:01:46.913 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl is inited.
17:01:46.913 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is inited.
17:01:46.913 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is inited.
17:01:46.914 [main] INFO  o.a.h.y.s.n.NodeStatusUpdaterImpl - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 physical-cores=8 virtual-cores=16
17:01:46.914 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl is inited.
17:01:46.914 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is inited.
17:01:46.915 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - Waiting for NM 0 to start...
17:01:46.915 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is started.
17:01:46.915 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService is started.
17:01:46.916 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerService is started.
17:01:46.916 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl is started.
17:01:46.927 [Thread-188] INFO  o.a.h.y.f.i.p.RpcServerFactoryPBImpl - Adding protocol org.apache.hadoop.yarn.api.ContainerManagerPB to the server
17:01:46.927 [Socket Reader #1 for port 43755] INFO  org.apache.hadoop.ipc.Server - Starting Socket Reader #1 for port 43755
17:01:46.928 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - IPC Server Responder: starting
17:01:46.928 [IPC Server listener on 43755] INFO  org.apache.hadoop.ipc.Server - IPC Server listener on 43755: starting
17:01:46.943 [Thread-188] INFO  o.a.h.y.s.n.c.ContainerManagerImpl - ContainerManager started at cetas-vm/10.115.171.101:43755
17:01:46.955 [Thread-188] INFO  o.a.h.y.f.i.p.RpcServerFactoryPBImpl - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
17:01:46.962 [Socket Reader #1 for port 34395] INFO  org.apache.hadoop.ipc.Server - Starting Socket Reader #1 for port 34395
17:01:46.963 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - IPC Server Responder: starting
17:01:46.963 [IPC Server listener on 34395] INFO  org.apache.hadoop.ipc.Server - IPC Server listener on 34395: starting
17:01:46.965 [Thread-188] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Localizer started on port 34395
17:01:46.965 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker is started.
17:01:46.966 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService is started.
17:01:46.966 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:containers-launcher is started.
17:01:46.966 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices is started.
17:01:46.966 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:containers-monitor is started.
17:01:46.966 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is started.
17:01:46.967 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler is started.
17:01:46.967 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl is started.
17:01:46.967 [Thread-188] INFO  o.a.h.y.s.n.webapp.WebServer - Instantiating NMWebApp at cetas-vm:0
17:01:46.968 [Thread-188] INFO  org.apache.hadoop.http.HttpServer - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
17:01:46.969 [Thread-188] INFO  org.apache.hadoop.http.HttpServer - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
17:01:46.969 [Thread-188] INFO  org.apache.hadoop.http.HttpServer - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
17:01:46.974 [Thread-188] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /node
17:01:46.974 [Thread-188] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /node/*
17:01:46.974 [Thread-188] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /ws
17:01:46.974 [Thread-188] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /ws/*
17:01:46.975 [Thread-188] INFO  org.apache.hadoop.http.HttpServer - Added global filter 'guice' (class=com.google.inject.servlet.GuiceFilter)
17:01:46.975 [Thread-188] INFO  org.apache.hadoop.http.HttpServer - Jetty bound to port 36497
17:01:46.975 [Thread-188] INFO  org.mortbay.log - jetty-6.1.26
17:01:46.980 [Thread-188] INFO  org.mortbay.log - Extract jar:file:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.0.4-alpha/hadoop-yarn-common-2.0.4-alpha.jar!/webapps/node to /tmp/Jetty_cetas.vm_36497_node____.m85jjl/webapp
Jul 10, 2013 5:01:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Jul 10, 2013 5:01:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Jul 10, 2013 5:01:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jul 10, 2013 5:01:47 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.8 06/24/2011 12:17 PM'
Jul 10, 2013 5:01:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jul 10, 2013 5:01:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jul 10, 2013 5:01:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
17:01:48.190 [Thread-188] INFO  org.mortbay.log - Started SelectChannelConnector@cetas-vm:36497
17:01:48.190 [Thread-188] INFO  o.apache.hadoop.yarn.webapp.WebApps - Web app /node started at 36497
Jul 10, 2013 5:01:48 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
17:01:48.209 [Thread-188] INFO  o.apache.hadoop.yarn.webapp.WebApps - Registered webapp guice modules
17:01:48.209 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is started.
17:01:48.209 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is started.
17:01:48.211 [Thread-188] INFO  o.a.h.y.s.n.NodeStatusUpdaterImpl - Connecting to ResourceManager at /0.0.0.0:8031
17:01:48.226 [Thread-188] INFO  o.a.hadoop.yarn.util.RackResolver - Resolved cetas-vm to /default-rack
17:01:48.229 [Thread-188] INFO  o.a.h.y.s.r.ResourceTrackerService - NodeManager from node cetas-vm(cmPort: 43755 httpPort: 36497) registered with capability: <memory:4096, vCores:16>, assigned nodeId cetas-vm:43755
17:01:48.229 [Thread-188] INFO  o.a.h.y.s.n.NodeStatusUpdaterImpl - Registered with ResourceManager as cetas-vm:43755 with total resource of <memory:4096, vCores:16>
17:01:48.229 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl is started.
17:01:48.230 [Thread-188] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is started.
17:01:48.231 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.MiniYARNCluster$NodeManagerWrapper_0 is started.
17:01:48.231 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - Created localDir in /root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-localDir-nm-1_0
17:01:48.231 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - Created logDir in /root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-logDir-nm-1_0
17:01:48.231 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - Starting NM: 1
17:01:48.233 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.rmnode.RMNodeImpl - cetas-vm:43755 Node Transitioned from NEW to RUNNING
17:01:48.235 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.c.CapacityScheduler - Added node cetas-vm:43755 clusterResource: <memory:4096, vCores:16>
17:01:48.265 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
17:01:48.265 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
17:01:48.265 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
17:01:48.265 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
17:01:48.265 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
17:01:48.265 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
17:01:48.266 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
17:01:48.266 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
17:01:48.266 [main] INFO  o.a.h.m.impl.MetricsSystemImpl - NodeManager metrics system started (again)
17:01:48.266 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is inited.
17:01:48.267 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService is inited.
17:01:48.268 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerService is inited.
17:01:48.269 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl is inited.
17:01:48.269 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
17:01:48.296 [main] INFO  o.a.h.yarn.event.AsyncDispatcher - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
17:01:48.297 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker is inited.
17:01:48.297 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService is inited.
17:01:48.297 [main] INFO  o.a.h.yarn.service.AbstractService - Service:containers-launcher is inited.
17:01:48.297 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices is inited.
17:01:48.297 [main] INFO  o.a.h.y.s.n.c.m.ContainersMonitorImpl -  Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@1e054543
17:01:48.297 [main] INFO  o.a.h.y.s.n.c.m.ContainersMonitorImpl -  Using ResourceCalculatorProcessTree : null
17:01:48.297 [main] INFO  o.a.h.y.s.n.c.m.ContainersMonitorImpl - Physical memory check enabled: true
17:01:48.297 [main] INFO  o.a.h.y.s.n.c.m.ContainersMonitorImpl - Virtual memory check enabled: true
17:01:48.298 [main] WARN  o.a.h.y.s.n.c.m.ContainersMonitorImpl - NodeManager configured with 4 G physical memory allocated to containers, which is more than 80% of the total physical memory available (4.2 G). Thrashing might happen.
17:01:48.299 [main] INFO  o.a.h.yarn.service.AbstractService - Service:containers-monitor is inited.
17:01:48.299 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is inited.
17:01:48.299 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler is inited.
17:01:48.299 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl is inited.
17:01:48.299 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is inited.
17:01:48.300 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is inited.
17:01:48.300 [main] INFO  o.a.h.y.s.n.NodeStatusUpdaterImpl - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 physical-cores=8 virtual-cores=16
17:01:48.300 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl is inited.
17:01:48.300 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is inited.
17:01:48.301 [main] INFO  o.a.h.yarn.server.MiniYARNCluster - Waiting for NM 1 to start...
17:01:48.301 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is started.
17:01:48.302 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService is started.
17:01:48.306 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerService is started.
17:01:48.306 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl is started.
17:01:48.308 [Socket Reader #1 for port 36143] INFO  org.apache.hadoop.ipc.Server - Starting Socket Reader #1 for port 36143
17:01:48.310 [Thread-228] INFO  o.a.h.y.f.i.p.RpcServerFactoryPBImpl - Adding protocol org.apache.hadoop.yarn.api.ContainerManagerPB to the server
17:01:48.311 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - IPC Server Responder: starting
17:01:48.312 [IPC Server listener on 36143] INFO  org.apache.hadoop.ipc.Server - IPC Server listener on 36143: starting
17:01:48.327 [Thread-228] INFO  o.a.h.y.s.n.c.ContainerManagerImpl - ContainerManager started at cetas-vm/10.115.171.101:36143
17:01:48.335 [Socket Reader #1 for port 36298] INFO  org.apache.hadoop.ipc.Server - Starting Socket Reader #1 for port 36298
17:01:48.338 [Thread-228] INFO  o.a.h.y.f.i.p.RpcServerFactoryPBImpl - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
17:01:48.339 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - IPC Server Responder: starting
17:01:48.340 [IPC Server listener on 36298] INFO  org.apache.hadoop.ipc.Server - IPC Server listener on 36298: starting
17:01:48.349 [Thread-228] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Localizer started on port 36298
17:01:48.350 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker is started.
17:01:48.350 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService is started.
17:01:48.352 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:containers-launcher is started.
17:01:48.352 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices is started.
17:01:48.353 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:containers-monitor is started.
17:01:48.356 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is started.
17:01:48.357 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler is started.
17:01:48.357 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl is started.
17:01:48.357 [Thread-228] INFO  o.a.h.y.s.n.webapp.WebServer - Instantiating NMWebApp at cetas-vm:0
17:01:48.358 [Thread-228] INFO  org.apache.hadoop.http.HttpServer - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
17:01:48.358 [Thread-228] INFO  org.apache.hadoop.http.HttpServer - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
17:01:48.358 [Thread-228] INFO  org.apache.hadoop.http.HttpServer - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
17:01:48.359 [Thread-228] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /node
17:01:48.359 [Thread-228] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /node/*
17:01:48.359 [Thread-228] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /ws
17:01:48.360 [Thread-228] INFO  org.apache.hadoop.http.HttpServer - adding path spec: /ws/*
17:01:48.360 [Thread-228] INFO  org.apache.hadoop.http.HttpServer - Added global filter 'guice' (class=com.google.inject.servlet.GuiceFilter)
17:01:48.360 [Thread-228] INFO  org.apache.hadoop.http.HttpServer - Jetty bound to port 47101
17:01:48.360 [Thread-228] INFO  org.mortbay.log - jetty-6.1.26
17:01:48.364 [Thread-228] INFO  org.mortbay.log - Extract jar:file:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.0.4-alpha/hadoop-yarn-common-2.0.4-alpha.jar!/webapps/node to /tmp/Jetty_cetas.vm_47101_node____.bb76b5/webapp
Jul 10, 2013 5:01:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jul 10, 2013 5:01:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jul 10, 2013 5:01:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jul 10, 2013 5:01:48 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.8 06/24/2011 12:17 PM'
Jul 10, 2013 5:01:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jul 10, 2013 5:01:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jul 10, 2013 5:01:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
17:01:48.673 [Thread-228] INFO  org.mortbay.log - Started SelectChannelConnector@cetas-vm:47101
17:01:48.679 [Thread-228] INFO  o.apache.hadoop.yarn.webapp.WebApps - Web app /node started at 47101
Jul 10, 2013 5:01:48 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
17:01:48.690 [Thread-228] INFO  o.apache.hadoop.yarn.webapp.WebApps - Registered webapp guice modules
17:01:48.691 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is started.
17:01:48.691 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is started.
17:01:48.692 [Thread-228] INFO  o.a.h.y.s.n.NodeStatusUpdaterImpl - Connecting to ResourceManager at /0.0.0.0:8031
17:01:48.692 [Thread-228] INFO  o.a.hadoop.yarn.util.RackResolver - Resolved cetas-vm to /default-rack
17:01:48.693 [Thread-228] INFO  o.a.h.y.s.r.ResourceTrackerService - NodeManager from node cetas-vm(cmPort: 36143 httpPort: 47101) registered with capability: <memory:4096, vCores:16>, assigned nodeId cetas-vm:36143
17:01:48.693 [Thread-228] INFO  o.a.h.y.s.n.NodeStatusUpdaterImpl - Registered with ResourceManager as cetas-vm:36143 with total resource of <memory:4096, vCores:16>
17:01:48.693 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.rmnode.RMNodeImpl - cetas-vm:36143 Node Transitioned from NEW to RUNNING
17:01:48.694 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.c.CapacityScheduler - Added node cetas-vm:36143 clusterResource: <memory:8192, vCores:32>
17:01:48.693 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl is started.
17:01:48.694 [Thread-228] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is started.
17:01:49.302 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.MiniYARNCluster$NodeManagerWrapper_1 is started.
17:01:49.302 [main] INFO  o.a.h.yarn.service.AbstractService - Service:com.yahoo.storm.yarn.TestIntegration is started.
17:01:51.694 [main] INFO  com.yahoo.storm.yarn.TestIntegration - Will be using storm found on PATH at ./lib/storm
17:01:51.821 [main] INFO  com.yahoo.storm.yarn.TestIntegration - bin/storm-yarn launch ./conf/storm.yaml --stormZip lib/storm.zip --appname storm-on-yarn-test --output target/appId.txt
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/hadoop-2.0.4-alpha/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/workspace/storm-yarn/lib/storm/lib/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
13/07/10 17:01:52 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
13/07/10 17:01:53 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/07/10 17:01:53 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
17:01:53.793 [IPC Server handler 0 on 42932] INFO  o.a.h.y.s.r.ClientRMService - Allocated new applicationId: 1
13/07/10 17:01:53 INFO yarn.StormOnYarn: Copy App Master jar from local filesystem and add to local environment
13/07/10 17:01:54 INFO yarn.StormOnYarn: Set the environment for the application master
13/07/10 17:01:54 INFO yarn.StormOnYarn: Setting up app master command:[find, ., -follow, |, xargs, ls, -ld, 1><LOG_DIR>/files, &&, echo, $CLASSPATH, 1><LOG_DIR>/classpath, &&, echo, $PWD, 1><LOG_DIR>/pwd, &&, java, -Dstorm.home=./storm/storm/, com.yahoo.storm.yarn.MasterServer, 1><LOG_DIR>/stdout, 2><LOG_DIR>/stderr]
17:01:54.219 [IPC Server handler 1 on 42932] INFO  o.a.h.y.s.r.ClientRMService - Storing Application with id application_1373500904722_0001
17:01:54.223 [IPC Server handler 1 on 42932] INFO  o.a.h.y.s.r.recovery.RMStateStore - Storing info for app: application_1373500904722_0001
17:01:54.224 [IPC Server handler 1 on 42932] INFO  o.a.h.y.s.r.ClientRMService - Application with id 1 submitted by user root
17:01:54.227 [IPC Server handler 1 on 42932] INFO  o.a.h.y.s.r.RMAuditLogger - USER=root IP=10.115.171.101 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1373500904722_0001
13/07/10 17:01:54 INFO client.YarnClientImpl: Submitted application application_1373500904722_0001 to ResourceManager at cetas-vm/10.115.171.101:42932
17:01:54.243 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.rmapp.RMAppImpl - application_1373500904722_0001 State change from NEW to SUBMITTED
17:01:54.243 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.ApplicationMasterService - Registering appattempt_1373500904722_0001_000001
17:01:54.287 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.r.a.RMAppAttemptImpl - appattempt_1373500904722_0001_000001 State change from NEW to SUBMITTED
17:01:54.311 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.LeafQueue - Application application_1373500904722_0001 from user: root activated in queue: default
17:01:54.312 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.LeafQueue - Application added - appId: application_1373500904722_0001 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@7e1aa73d, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
17:01:54.312 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.ParentQueue - Application added - appId: application_1373500904722_0001 user: root leaf-queue of parent: root #applications: 1
17:01:54.312 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.c.CapacityScheduler - Application Submission: appattempt_1373500904722_0001_000001, user: root queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0, currently active: 1
17:01:54.316 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.r.a.RMAppAttemptImpl - appattempt_1373500904722_0001_000001 State change from SUBMITTED to SCHEDULED
17:01:54.316 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.rmapp.RMAppImpl - application_1373500904722_0001 State change from SUBMITTED to ACCEPTED
13/07/10 17:01:54 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is stopped.
17:01:54.714 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.r.RMContainerImpl - container_1373500904722_0001_01_000001 Container Transitioned from NEW to ALLOCATED
17:01:54.714 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.RMAuditLogger - USER=root OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1373500904722_0001 CONTAINERID=container_1373500904722_0001_01_000001
17:01:54.714 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.c.f.FiCaSchedulerNode - Assigned container container_1373500904722_0001_01_000001 of capacity <memory:2048, vCores:1> on host cetas-vm:36143, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:15> available
17:01:54.717 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.LeafQueue - assignedContainer application=application_1373500904722_0001 container=Container: [ContainerId: container_1373500904722_0001_01_000001, NodeId: cetas-vm:36143, NodeHttpAddress: cetas-vm:47101, Resource: <memory:2048, vCores:1>, Priority: 0, State: NEW, Token: null, Status: container_id {, app_attempt_id {, application_id {, id: 1, cluster_timestamp: 1373500904722, }, attemptId: 1, }, id: 1, }, state: C_NEW, ] containerId=container_1373500904722_0001_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0 usedCapacity=0.0 absoluteUsedCapacity=0.0 used=<memory:0, vCores:0> cluster=<memory:8192, vCores:32>
17:01:54.718 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.ParentQueue - Re-sorting queues since queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=1
17:01:54.719 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.ParentQueue - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:2048, vCores:1> cluster=<memory:8192, vCores:32>
17:01:54.719 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.r.RMContainerImpl - container_1373500904722_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
17:01:54.720 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.r.a.RMAppAttemptImpl - Storing attempt: AppId: application_1373500904722_0001 AttemptId: appattempt_1373500904722_0001_000001 MasterContainer: Container: [ContainerId: container_1373500904722_0001_01_000001, NodeId: cetas-vm:36143, NodeHttpAddress: cetas-vm:47101, Resource: <memory:2048, vCores:1>, Priority: 0, State: NEW, Token: null, Status: container_id {, app_attempt_id {, application_id {, id: 1, cluster_timestamp: 1373500904722, }, attemptId: 1, }, id: 1, }, state: C_NEW, ]
17:01:54.721 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.r.a.RMAppAttemptImpl - appattempt_1373500904722_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING
17:01:54.723 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.recovery.RMStateStore - Storing info for attempt: appattempt_1373500904722_0001_000001
17:01:54.724 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.r.a.RMAppAttemptImpl - appattempt_1373500904722_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED
17:01:54.727 [pool-2-thread-1] INFO  o.a.h.y.s.r.amlauncher.AMLauncher - Launching masterappattempt_1373500904722_0001_000001
17:01:54.739 [pool-2-thread-1] INFO  o.a.h.y.s.r.amlauncher.AMLauncher - Setting up container Container: [ContainerId: container_1373500904722_0001_01_000001, NodeId: cetas-vm:36143, NodeHttpAddress: cetas-vm:47101, Resource: <memory:2048, vCores:1>, Priority: 0, State: NEW, Token: null, Status: container_id {, app_attempt_id {, application_id {, id: 1, cluster_timestamp: 1373500904722, }, attemptId: 1, }, id: 1, }, state: C_NEW, ] for AM appattempt_1373500904722_0001_000001
17:01:54.739 [pool-2-thread-1] INFO  o.a.h.y.s.r.amlauncher.AMLauncher - Command to launch container container_1373500904722_0001_01_000001 : find,.,-follow,|,xargs,ls,-ld,1><LOG_DIR>/files,&&,echo,$CLASSPATH,1><LOG_DIR>/classpath,&&,echo,$PWD,1><LOG_DIR>/pwd,&&,java,-Dstorm.home=./storm/storm/,com.yahoo.storm.yarn.MasterServer,1><LOG_DIR>/stdout,2><LOG_DIR>/stderr
17:01:54.782 [IPC Server handler 0 on 36143] INFO  o.a.h.y.s.n.c.ContainerManagerImpl - Start request for container_1373500904722_0001_01_000001 by user root
17:01:54.795 [IPC Server handler 0 on 36143] INFO  o.a.h.y.s.n.c.ContainerManagerImpl - Creating a new application reference for app application_1373500904722_0001
17:01:54.797 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.a.Application - Application application_1373500904722_0001 transitioned from NEW to INITING
17:01:54.801 [IPC Server handler 0 on 36143] INFO  o.a.h.y.s.nodemanager.NMAuditLogger - USER=root IP=10.115.171.101 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1373500904722_0001 CONTAINERID=container_1373500904722_0001_01_000001
17:01:54.803 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.a.Application - Adding container_1373500904722_0001_01_000001 to application application_1373500904722_0001
17:01:54.804 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.a.Application - Application application_1373500904722_0001 transitioned from INITING to RUNNING
17:01:54.806 [pool-2-thread-1] INFO  o.a.h.y.s.r.amlauncher.AMLauncher - Done launching container Container: [ContainerId: container_1373500904722_0001_01_000001, NodeId: cetas-vm:36143, NodeHttpAddress: cetas-vm:47101, Resource: <memory:2048, vCores:1>, Priority: 0, State: NEW, Token: null, Status: container_id {, app_attempt_id {, application_id {, id: 1, cluster_timestamp: 1373500904722, }, attemptId: 1, }, id: 1, }, state: C_NEW, ] for AM appattempt_1373500904722_0001_000001
17:01:54.807 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.r.a.RMAppAttemptImpl - appattempt_1373500904722_0001_000001 State change from ALLOCATED to LAUNCHED
17:01:54.811 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.container.Container - Container container_1373500904722_0001_01_000001 transitioned from NEW to LOCALIZING
17:01:54.817 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.l.LocalizedResource - Resource file:/root/workspace/storm-yarn/lib/storm.zip transitioned from INIT to DOWNLOADING
17:01:54.817 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.l.LocalizedResource - Resource file:/root/.storm/application_1373500904722_0001/AppMaster.jar transitioned from INIT to DOWNLOADING
17:01:54.817 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.l.LocalizedResource - Resource file:/root/.storm/application_1373500904722_0001/conf transitioned from INIT to DOWNLOADING
17:01:54.818 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Downloading public rsrc:{ file:/root/workspace/storm-yarn/lib/storm.zip, 1373490459000, ARCHIVE, null }
17:01:54.841 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Created localizer for container_1373500904722_0001_01_000001
17:01:54.871 [LocalizerRunner for container_1373500904722_0001_01_000001] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Writing credentials to the nmPrivate file /root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-localDir-nm-1_0/nmPrivate/container_1373500904722_0001_01_000001.tokens. Credentials list: 
17:01:54.880 [LocalizerRunner for container_1373500904722_0001_01_000001] INFO  o.a.h.y.s.n.DefaultContainerExecutor - Initializing user root
17:01:54.939 [LocalizerRunner for container_1373500904722_0001_01_000001] INFO  o.a.h.y.s.n.DefaultContainerExecutor - Copying from /root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-localDir-nm-1_0/nmPrivate/container_1373500904722_0001_01_000001.tokens to /root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-localDir-nm-1_0/usercache/root/appcache/application_1373500904722_0001/container_1373500904722_0001_01_000001.tokens
17:01:54.939 [LocalizerRunner for container_1373500904722_0001_01_000001] INFO  o.a.h.y.s.n.DefaultContainerExecutor - CWD set to /root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-localDir-nm-1_0/usercache/root/appcache/application_1373500904722_0001 = file:/root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-localDir-nm-1_0/usercache/root/appcache/application_1373500904722_0001
17:01:54.946 [Public Localizer] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Failed to download rsrc { { file:/root/workspace/storm-yarn/lib/storm.zip, 1373490459000, ARCHIVE, null },pending,[(container_1373500904722_0001_01_000001)],196635887646575,DOWNLOADING}
java.io.IOException: Resource file:/root/workspace/storm-yarn/lib/storm.zip is not publicly accessable and as such cannot be part of the public cache.
at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:184) ~[hadoop-yarn-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:280) ~[hadoop-yarn-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:51) ~[hadoop-yarn-common-2.0.4-alpha.jar:na]
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) ~[na:1.7.0_25]
at java.util.concurrent.FutureTask.run(FutureTask.java:166) ~[na:1.7.0_25]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_25]
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) ~[na:1.7.0_25]
at java.util.concurrent.FutureTask.run(FutureTask.java:166) ~[na:1.7.0_25]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_25]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ~[na:1.7.0_25]
at java.lang.Thread.run(Thread.java:724) ~[na:1.7.0_25]
17:01:54.948 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.container.Container - Container container_1373500904722_0001_01_000001 transitioned from LOCALIZING to LOCALIZATION_FAILED
17:01:54.949 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.l.LocalizedResource - Resource file:/root/workspace/storm-yarn/lib/storm.zip transitioned from DOWNLOADING to INIT
17:01:54.949 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.l.LocalizedResource - Resource file:/root/.storm/application_1373500904722_0001/AppMaster.jar transitioned from DOWNLOADING to INIT
17:01:54.949 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.l.LocalizedResource - Resource file:/root/.storm/application_1373500904722_0001/conf transitioned from DOWNLOADING to INIT
17:01:54.952 [DeletionService #0] INFO  o.a.h.y.s.n.DefaultContainerExecutor - Deleting absolute path : /root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-localDir-nm-1_0/usercache/root/appcache/application_1373500904722_0001/container_1373500904722_0001_01_000001
17:01:54.953 [DeletionService #0] WARN  o.a.h.y.s.n.DefaultContainerExecutor - delete returned false for path: [/root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-localDir-nm-1_0/usercache/root/appcache/application_1373500904722_0001/container_1373500904722_0001_01_000001]
17:01:54.953 [AsyncDispatcher event handler] WARN  o.a.h.y.s.nodemanager.NMAuditLogger - USER=root OPERATION=Container Finished - Failed TARGET=ContainerImpl RESULT=FAILURE DESCRIPTION=Container failed with state: LOCALIZATION_FAILED APPID=application_1373500904722_0001 CONTAINERID=container_1373500904722_0001_01_000001
17:01:54.955 [LocalizerRunner for container_1373500904722_0001_01_000001] WARN  org.apache.hadoop.util.Shell - Interrupted while reading the error stream
java.lang.InterruptedException: null
at java.lang.Object.wait(Native Method) ~[na:1.7.0_25]
at java.lang.Thread.join(Thread.java:1260) ~[na:1.7.0_25]
at java.lang.Thread.join(Thread.java:1334) ~[na:1.7.0_25]
at org.apache.hadoop.util.Shell.runCommand(Shell.java:194) [hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.util.Shell.run(Shell.java:129) [hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:322) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.util.Shell.execCommand(Shell.java:411) [hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.util.Shell.execCommand(Shell.java:394) [hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.fs.RawLocalFileSystem.execCommand(RawLocalFileSystem.java:617) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:608) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:407) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.fs.FileSystem.primitiveMkdir(FileSystem.java:1008) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.fs.DelegateToFileSystem.mkdir(DelegateToFileSystem.java:150) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.fs.FilterFs.mkdir(FilterFs.java:187) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.fs.FileContext$4.next(FileContext.java:730) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.fs.FileContext$4.next(FileContext.java:726) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2379) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.fs.FileContext.mkdir(FileContext.java:726) ~[hadoop-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.initDirs(ContainerLocalizer.java:385) ~[hadoop-yarn-server-nodemanager-2.0.4-alpha.jar:na]
at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:130) ~[hadoop-yarn-server-nodemanager-2.0.4-alpha.jar:na]
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:103) ~[hadoop-yarn-server-nodemanager-2.0.4-alpha.jar:na]
at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:859) ~[hadoop-yarn-server-nodemanager-2.0.4-alpha.jar:na]
17:01:54.956 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.container.Container - Container container_1373500904722_0001_01_000001 transitioned from LOCALIZATION_FAILED to DONE
17:01:54.957 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.a.Application - Removing container_1373500904722_0001_01_000001 from application application_1373500904722_0001
17:01:54.958 [Thread-284] WARN  org.apache.hadoop.util.Shell - Error reading the error stream
java.io.IOException: Stream closed
at java.io.BufferedReader.ensureOpen(BufferedReader.java:115) ~[na:1.7.0_25]
at java.io.BufferedReader.readLine(BufferedReader.java:310) ~[na:1.7.0_25]
at java.io.BufferedReader.readLine(BufferedReader.java:382) ~[na:1.7.0_25]
at org.apache.hadoop.util.Shell$1.run(Shell.java:169) ~[hadoop-common-2.0.4-alpha.jar:na]
17:01:55.099 [IPC Server handler 1 on 36298] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Unknown localizer with localizerId container_1373500904722_0001_01_000001 is sending heartbeat. Ordering it to DIE
17:01:55.111 [IPC Server handler 0 on 36298] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Unknown localizer with localizerId container_1373500904722_0001_01_000001 is sending heartbeat. Ordering it to DIE
17:01:55.705 [Node Status Updater] INFO  o.a.h.y.s.n.NodeStatusUpdaterImpl - Sending out status for container: container_id {, app_attempt_id {, application_id {, id: 1, cluster_timestamp: 1373500904722, }, attemptId: 1, }, id: 1, }, state: C_COMPLETE, diagnostics: "java.io.IOException: Resource file:/root/workspace/storm-yarn/lib/storm.zip is not publicly accessable and as such cannot be part of the public cache.\n\tat org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:184)\n\tat org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:280)\n\tat org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:51)\n\tat java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:166)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)\n\tat java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:166)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat java.lang.Thread.run(Thread.java:724)\n\n", exit_status: -1000, 
17:01:55.706 [Node Status Updater] INFO  o.a.h.y.s.n.NodeStatusUpdaterImpl - Removed completed container container_1373500904722_0001_01_000001
17:01:55.709 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.r.RMContainerImpl - container_1373500904722_0001_01_000001 Container Transitioned from ACQUIRED to COMPLETED
17:01:55.709 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.c.f.FiCaSchedulerApp - Completed container: container_1373500904722_0001_01_000001 in state: COMPLETED event:FINISHED
17:01:55.709 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.RMAuditLogger - USER=root OPERATION=AM Released Container TARGET=SchedulerAppRESULT=SUCCESS APPID=application_1373500904722_0001 CONTAINERID=container_1373500904722_0001_01_000001
17:01:55.709 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.c.f.FiCaSchedulerNode - Released container container_1373500904722_0001_01_000001 of capacity <memory:2048, vCores:1> on host cetas-vm:36143, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:16> available, release resources=true
17:01:55.709 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.LeafQueue - default used=<memory:0, vCores:0> numContainers=0 user=root user-resources=<memory:0, vCores:0>
17:01:55.710 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.r.a.RMAppAttemptImpl - appattempt_1373500904722_0001_000001 State change from LAUNCHED to FAILED
17:01:55.711 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.rmapp.RMAppImpl - Application application_1373500904722_0001 failed 1 times due to AM Container for appattempt_1373500904722_0001_000001 exited with  exitCode: -1000 due to: java.io.IOException: Resource file:/root/workspace/storm-yarn/lib/storm.zip is not publicly accessable and as such cannot be part of the public cache.
at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:184)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:280)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:51)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)

.Failing this attempt.. Failing the application.
17:01:55.711 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.rmapp.RMAppImpl - application_1373500904722_0001 State change from ACCEPTED to FAILED
17:01:55.711 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.LeafQueue - completedContainer container=Container: [ContainerId: container_1373500904722_0001_01_000001, NodeId: cetas-vm:36143, NodeHttpAddress: cetas-vm:47101, Resource: <memory:2048, vCores:1>, Priority: 0, State: NEW, Token: null, Status: container_id {, app_attempt_id {, application_id {, id: 1, cluster_timestamp: 1373500904722, }, attemptId: 1, }, id: 1, }, state: C_COMPLETE, diagnostics: "java.io.IOException: Resource file:/root/workspace/storm-yarn/lib/storm.zip is not publicly accessable and as such cannot be part of the public cache.\n\tat org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:184)\n\tat org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:280)\n\tat org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:51)\n\tat java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:166)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)\n\tat java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:166)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat java.lang.Thread.run(Thread.java:724)\n\n", exit_status: -1000, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0 usedCapacity=0.0 absoluteUsedCapacity=0.0 used=<memory:0, vCores:0> cluster=<memory:8192, vCores:32>
17:01:55.711 [AsyncDispatcher event handler] WARN  o.a.h.y.s.r.RMAuditLogger - USER=root OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1373500904722_0001 failed 1 times due to AM Container for appattempt_1373500904722_0001_000001 exited with  exitCode: -1000 due to: java.io.IOException: Resource file:/root/workspace/storm-yarn/lib/storm.zip is not publicly accessable and as such cannot be part of the public cache.
at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:184)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:280)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:51)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)

.Failing this attempt.. Failing the application. APPID=application_1373500904722_0001
17:01:55.712 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.ParentQueue - completedContainer queue=root usedCapacity=0.0 absoluteUsedCapacity=0.0 used=<memory:0, vCores:0> cluster=<memory:8192, vCores:32>
17:01:55.712 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.c.CapacityScheduler - Application appattempt_1373500904722_0001_000001 released container container_1373500904722_0001_01_000001 on node: host: cetas-vm:36143 #containers=0 available=4096 used=0 with event: FINISHED
17:01:55.712 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.c.CapacityScheduler - Application appattempt_1373500904722_0001_000001 is done. finalState=FAILED
17:01:55.713 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.recovery.RMStateStore - Removing info for app: application_1373500904722_0001
17:01:55.713 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.AppSchedulingInfo - Application application_1373500904722_0001 requests cleared
17:01:55.713 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.LeafQueue - Application removed - appId: application_1373500904722_0001 user: root queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0
17:01:55.714 [ResourceManager Event Processor] INFO  o.a.h.y.s.r.s.capacity.ParentQueue - Application removed - appId: application_1373500904722_0001 user: root leaf-queue of parent: root #applications: 0
17:01:55.715 [AsyncDispatcher event handler] INFO  o.a.h.y.s.r.RMAppManager$ApplicationSummary - appId=application_1373500904722_0001,name=storm-on-yarn-test,user=root,queue=default,state=FAILED,trackingUrl=cetas-vm:40492/proxy/application_1373500904722_0001/,appMasterHost=N/A,startTime=1373500914216,finishTime=1373500915711
17:01:56.711 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.a.Application - Application application_1373500904722_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
17:01:56.711 [DeletionService #1] INFO  o.a.h.y.s.n.DefaultContainerExecutor - Deleting absolute path : /root/workspace/storm-yarn/target/com.yahoo.storm.yarn.TestIntegration/com.yahoo.storm.yarn.TestIntegration-localDir-nm-1_0/usercache/root/appcache/application_1373500904722_0001
17:01:56.712 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.AuxServices - Got event APPLICATION_STOP for appId application_1373500904722_0001
17:01:56.714 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.a.Application - Application application_1373500904722_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
17:01:56.714 [AsyncDispatcher event handler] INFO  o.a.h.y.s.n.c.l.NonAggregatingLogHandler - Scheduling Log Deletion for application: application_1373500904722_0001, with delay of 10800 seconds
17:01:57.358 [Container Monitor] INFO  o.a.h.y.s.n.c.m.ContainersMonitorImpl - Stopping resource-monitoring for container_1373500904722_0001_01_000001
17:02:09.346 [main] INFO  com.yahoo.storm.yarn.TestIntegration - application ID:application_1373500904722_0001
17:02:09.349 [main] INFO  com.yahoo.storm.yarn.TestIntegration - bin/storm-yarn getStormConfig ./conf/storm.yaml --appId application_1373500904722_0001 --output ./lib/storm/storm.yaml
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/hadoop-2.0.4-alpha/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/workspace/storm-yarn/lib/storm/lib/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
13/07/10 17:02:10 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
13/07/10 17:02:10 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/07/10 17:02:11 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
13/07/10 17:02:11 INFO yarn.StormOnYarn: application report for application_1373500904722_0001 :N/A:0
13/07/10 17:02:11 INFO yarn.StormOnYarn: Attaching to N/A:0 to talk to app master application_1373500904722_0001
13/07/10 17:02:11 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is stopped.
Exception in thread "main" java.lang.IllegalArgumentException: invalid port: 0
at backtype.storm.security.auth.ThriftClient.<init>(ThriftClient.java:37)
at com.yahoo.storm.yarn.MasterClient.<init>(MasterClient.java:48)
at com.yahoo.storm.yarn.MasterClient.getConfiguredClient(MasterClient.java:38)
at com.yahoo.storm.yarn.StormOnYarn.getClient(StormOnYarn.java:113)
at com.yahoo.storm.yarn.StormMasterCommand.process(StormMasterCommand.java:76)
at com.yahoo.storm.yarn.Client.execute(Client.java:139)
at com.yahoo.storm.yarn.Client.main(Client.java:145)
17:02:12.370 [main] INFO  com.yahoo.storm.yarn.TestIntegration - ./lib/storm/bin/storm jar lib/storm-starter-0.0.1-SNAPSHOT.jar storm.starter.ExclamationTopology exclamation-topology
Exception in thread "main" java.lang.RuntimeException: org.apache.thrift7.transport.TTransportException: java.net.ConnectException: Connection refused
at backtype.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:21)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:70)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:41)
at storm.starter.ExclamationTopology.main(ExclamationTopology.java:60)
Caused by: org.apache.thrift7.transport.TTransportException: java.net.ConnectException: Connection refused
at org.apache.thrift7.transport.TSocket.open(TSocket.java:183)
at org.apache.thrift7.transport.TFramedTransport.open(TFramedTransport.java:81)
at backtype.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:66)
at backtype.storm.security.auth.ThriftClient.<init>(ThriftClient.java:46)
at backtype.storm.utils.NimbusClient.<init>(NimbusClient.java:30)
at backtype.storm.utils.NimbusClient.<init>(NimbusClient.java:26)
at backtype.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:19)
... 3 more
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at org.apache.thrift7.transport.TSocket.open(TSocket.java:178)
... 9 more
17:02:45.074 [main] INFO  com.yahoo.storm.yarn.TestIntegration - ./lib/storm/bin/storm kill exclamation-topology
767  [main] INFO  backtype.storm.thrift - Connecting to Nimbus at localhost:6627
Exception in thread "main" org.apache.thrift7.transport.TTransportException: java.net.ConnectException: Connection refused
at org.apache.thrift7.transport.TSocket.open(TSocket.java:183)
at org.apache.thrift7.transport.TFramedTransport.open(TFramedTransport.java:81)
at backtype.storm.thrift$nimbus_client_and_conn.invoke(thrift.clj:56)
at backtype.storm.command.kill_topology$_main.doInvoke(kill_topology.clj:11)
at clojure.lang.RestFn.applyTo(RestFn.java:137)
at backtype.storm.command.kill_topology.main(Unknown Source)
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at org.apache.thrift7.transport.TSocket.open(TSocket.java:178)
... 5 more
17:02:50.760 [main] INFO  com.yahoo.storm.yarn.TestIntegration - bin/storm-yarn stopNimbus ./conf/storm.yaml --appId application_1373500904722_0001
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/hadoop-2.0.4-alpha/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/workspace/storm-yarn/lib/storm/lib/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
13/07/10 17:02:51 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
13/07/10 17:02:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/07/10 17:02:52 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
13/07/10 17:02:52 INFO yarn.StormOnYarn: application report for application_1373500904722_0001 :N/A:0
13/07/10 17:02:52 INFO yarn.StormOnYarn: Attaching to N/A:0 to talk to app master application_1373500904722_0001
13/07/10 17:02:52 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is stopped.
Exception in thread "main" java.lang.IllegalArgumentException: invalid port: 0
at backtype.storm.security.auth.ThriftClient.<init>(ThriftClient.java:37)
at com.yahoo.storm.yarn.MasterClient.<init>(MasterClient.java:48)
at com.yahoo.storm.yarn.MasterClient.getConfiguredClient(MasterClient.java:38)
at com.yahoo.storm.yarn.StormOnYarn.getClient(StormOnYarn.java:113)
at com.yahoo.storm.yarn.StormMasterCommand.process(StormMasterCommand.java:76)
at com.yahoo.storm.yarn.Client.execute(Client.java:139)
at com.yahoo.storm.yarn.Client.main(Client.java:145)
17:02:53.598 [main] INFO  com.yahoo.storm.yarn.TestIntegration - bin/storm-yarn startNimbus ./conf/storm.yaml --appId application_1373500904722_0001
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/hadoop-2.0.4-alpha/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/workspace/storm-yarn/lib/storm/lib/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
13/07/10 17:02:54 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
13/07/10 17:02:54 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/07/10 17:02:55 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
13/07/10 17:02:55 INFO yarn.StormOnYarn: application report for application_1373500904722_0001 :N/A:0
13/07/10 17:02:55 INFO yarn.StormOnYarn: Attaching to N/A:0 to talk to app master application_1373500904722_0001
13/07/10 17:02:55 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is stopped.
Exception in thread "main" java.lang.IllegalArgumentException: invalid port: 0
at backtype.storm.security.auth.ThriftClient.<init>(ThriftClient.java:37)
at com.yahoo.storm.yarn.MasterClient.<init>(MasterClient.java:48)
at com.yahoo.storm.yarn.MasterClient.getConfiguredClient(MasterClient.java:38)
at com.yahoo.storm.yarn.StormOnYarn.getClient(StormOnYarn.java:113)
at com.yahoo.storm.yarn.StormMasterCommand.process(StormMasterCommand.java:76)
at com.yahoo.storm.yarn.Client.execute(Client.java:139)
at com.yahoo.storm.yarn.Client.main(Client.java:145)
17:02:56.435 [main] INFO  com.yahoo.storm.yarn.TestIntegration - bin/storm-yarn stopUI ./conf/storm.yaml --appId application_1373500904722_0001
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/hadoop-2.0.4-alpha/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/workspace/storm-yarn/lib/storm/lib/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
13/07/10 17:02:57 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
13/07/10 17:02:57 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/07/10 17:02:58 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
13/07/10 17:02:58 INFO yarn.StormOnYarn: application report for application_1373500904722_0001 :N/A:0
13/07/10 17:02:58 INFO yarn.StormOnYarn: Attaching to N/A:0 to talk to app master application_1373500904722_0001
13/07/10 17:02:58 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is stopped.
Exception in thread "main" java.lang.IllegalArgumentException: invalid port: 0
at backtype.storm.security.auth.ThriftClient.<init>(ThriftClient.java:37)
at com.yahoo.storm.yarn.MasterClient.<init>(MasterClient.java:48)
at com.yahoo.storm.yarn.MasterClient.getConfiguredClient(MasterClient.java:38)
at com.yahoo.storm.yarn.StormOnYarn.getClient(StormOnYarn.java:113)
at com.yahoo.storm.yarn.StormMasterCommand.process(StormMasterCommand.java:76)
at com.yahoo.storm.yarn.Client.execute(Client.java:139)
at com.yahoo.storm.yarn.Client.main(Client.java:145)
17:02:59.342 [main] INFO  com.yahoo.storm.yarn.TestIntegration - bin/storm-yarn startUI ./conf/storm.yaml --appId application_1373500904722_0001
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/hadoop-2.0.4-alpha/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/workspace/storm-yarn/lib/storm/lib/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
13/07/10 17:03:00 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
13/07/10 17:03:00 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/07/10 17:03:01 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
13/07/10 17:03:01 INFO yarn.StormOnYarn: application report for application_1373500904722_0001 :N/A:0
13/07/10 17:03:01 INFO yarn.StormOnYarn: Attaching to N/A:0 to talk to app master application_1373500904722_0001
13/07/10 17:03:01 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is stopped.
Exception in thread "main" java.lang.IllegalArgumentException: invalid port: 0
at backtype.storm.security.auth.ThriftClient.<init>(ThriftClient.java:37)
at com.yahoo.storm.yarn.MasterClient.<init>(MasterClient.java:48)
at com.yahoo.storm.yarn.MasterClient.getConfiguredClient(MasterClient.java:38)
at com.yahoo.storm.yarn.StormOnYarn.getClient(StormOnYarn.java:113)
at com.yahoo.storm.yarn.StormMasterCommand.process(StormMasterCommand.java:76)
at com.yahoo.storm.yarn.Client.execute(Client.java:139)
at com.yahoo.storm.yarn.Client.main(Client.java:145)
17:03:02.212 [main] INFO  com.yahoo.storm.yarn.TestIntegration - bin/storm-yarn shutdown ./conf/storm.yaml --appId application_1373500904722_0001
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/hadoop-2.0.4-alpha/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/workspace/storm-yarn/lib/storm/lib/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
13/07/10 17:03:03 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
13/07/10 17:03:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/07/10 17:03:03 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
13/07/10 17:03:04 INFO yarn.StormOnYarn: application report for application_1373500904722_0001 :N/A:0
13/07/10 17:03:04 INFO yarn.StormOnYarn: Attaching to N/A:0 to talk to app master application_1373500904722_0001
13/07/10 17:03:04 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is stopped.
Exception in thread "main" java.lang.IllegalArgumentException: invalid port: 0
at backtype.storm.security.auth.ThriftClient.<init>(ThriftClient.java:37)
at com.yahoo.storm.yarn.MasterClient.<init>(MasterClient.java:48)
at com.yahoo.storm.yarn.MasterClient.getConfiguredClient(MasterClient.java:38)
at com.yahoo.storm.yarn.StormOnYarn.getClient(StormOnYarn.java:113)
at com.yahoo.storm.yarn.StormMasterCommand.process(StormMasterCommand.java:76)
at com.yahoo.storm.yarn.Client.execute(Client.java:139)
at com.yahoo.storm.yarn.Client.main(Client.java:145)
17:03:05.088 [main] INFO  c.yahoo.storm.yarn.EmbeddedZKServer - shutdown embedded zookeeper server with port 60000
17:03:05.089 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:60000] INFO  o.a.z.server.NIOServerCnxnFactory - NIOServerCnxn factory exited run method
17:03:05.089 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - shutting down
17:03:05.090 [main] INFO  o.a.z.server.SessionTrackerImpl - Shutting down
17:03:05.090 [main] INFO  o.a.z.server.PrepRequestProcessor - Shutting down
17:03:05.090 [main] INFO  o.a.z.server.SyncRequestProcessor - Shutting down
17:03:05.090 [ProcessThread(sid:0 cport:-1):] INFO  o.a.z.server.PrepRequestProcessor - PrepRequestProcessor exited loop!
17:03:05.090 [SyncThread:0] INFO  o.a.z.server.SyncRequestProcessor - SyncRequestProcessor exited!
17:03:05.090 [main] INFO  o.a.z.server.FinalRequestProcessor - shutdown of request processor complete
17:03:05.091 [main] INFO  com.yahoo.storm.yarn.TestIntegration - shutdown MiniYarn cluster
17:03:05.091 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl is stopped.
17:03:05.092 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is stopped.
17:03:05.097 [main] INFO  org.mortbay.log - Stopped SelectChannelConnector@cetas-vm:0
17:03:05.100 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is stopped.
17:03:05.101 [main] INFO  org.apache.hadoop.ipc.Server - Stopping server on 36143
17:03:05.106 [IPC Server listener on 36143] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server listener on 36143
17:03:05.107 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server Responder
17:03:06.000 [SessionTracker] INFO  o.a.z.server.SessionTrackerImpl - SessionTrackerImpl exited loop!
17:03:15.108 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler is stopped.
17:03:15.110 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is stopped.
17:03:15.111 [Container Monitor] WARN  o.a.h.y.s.n.c.m.ContainersMonitorImpl - org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting.
17:03:15.112 [main] INFO  o.a.h.yarn.service.AbstractService - Service:containers-monitor is stopped.
17:03:15.112 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices is stopped.
17:03:15.112 [main] INFO  o.a.h.yarn.service.AbstractService - Service:containers-launcher is stopped.
17:03:15.113 [main] INFO  org.apache.hadoop.ipc.Server - Stopping server on 36298
17:03:15.115 [IPC Server listener on 36298] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server listener on 36298
17:03:15.115 [Public Localizer] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Public cache exiting
17:03:15.115 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server Responder
17:03:15.115 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker is stopped.
17:03:15.115 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService is stopped.
17:03:15.115 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl is stopped.
17:03:15.115 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl is stopped.
17:03:15.117 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService is stopped.
17:03:15.117 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerService is stopped.
17:03:15.118 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is stopped.
17:03:15.118 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is stopped.
17:03:15.118 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.MiniYARNCluster$NodeManagerWrapper_1 is stopped.
17:03:15.119 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl is stopped.
17:03:15.119 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is stopped.
17:03:15.132 [main] INFO  org.mortbay.log - Stopped SelectChannelConnector@cetas-vm:0
17:03:15.233 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is stopped.
17:03:15.233 [main] INFO  org.apache.hadoop.ipc.Server - Stopping server on 43755
17:03:15.237 [IPC Server listener on 43755] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server listener on 43755
17:03:15.238 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server Responder
17:03:15.238 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler is stopped.
17:03:15.239 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is stopped.
17:03:15.239 [Container Monitor] WARN  o.a.h.y.s.n.c.m.ContainersMonitorImpl - org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting.
17:03:15.239 [main] INFO  o.a.h.yarn.service.AbstractService - Service:containers-monitor is stopped.
17:03:15.239 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices is stopped.
17:03:15.239 [main] INFO  o.a.h.yarn.service.AbstractService - Service:containers-launcher is stopped.
17:03:15.240 [main] INFO  org.apache.hadoop.ipc.Server - Stopping server on 34395
17:03:15.241 [IPC Server listener on 34395] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server listener on 34395
17:03:15.242 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server Responder
17:03:15.242 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker is stopped.
17:03:15.242 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService is stopped.
17:03:15.243 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl is stopped.
17:03:15.243 [Public Localizer] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Public cache exiting
17:03:15.243 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl is stopped.
17:03:15.243 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService is stopped.
17:03:15.243 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerService is stopped.
17:03:15.244 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is stopped.
17:03:15.244 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is stopped.
17:03:15.244 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.MiniYARNCluster$NodeManagerWrapper_0 is stopped.
17:03:15.245 [main] INFO  org.mortbay.log - Stopped SelectChannelConnector@cetas-vm:0
17:03:15.246 [Thread[Thread-11,5,main]] ERROR o.a.h.s.t.d.AbstractDelegationTokenSecretManager - InterruptedExcpetion recieved for ExpiredTokenRemover thread java.lang.InterruptedException: sleep interrupted
17:03:15.248 [main] INFO  o.a.h.m.impl.MetricsSystemImpl - Stopping NodeManager metrics system...
17:03:15.250 [main] INFO  o.a.h.m.impl.MetricsSystemImpl - NodeManager metrics system stopped.
17:03:15.251 [main] INFO  o.a.h.m.impl.MetricsSystemImpl - NodeManager metrics system shutdown complete.
17:03:15.251 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is stopped.
17:03:15.251 [ApplicationMaster Launcher] WARN  o.a.h.y.s.r.a.ApplicationMasterLauncher - org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning.
17:03:15.252 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher is stopped.
17:03:15.252 [main] INFO  org.apache.hadoop.ipc.Server - Stopping server on 39267
17:03:15.253 [IPC Server listener on 39267] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server listener on 39267
17:03:15.253 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server Responder
17:03:15.254 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.AdminService is stopped.
17:03:15.254 [main] INFO  org.apache.hadoop.ipc.Server - Stopping server on 42932
17:03:15.259 [IPC Server listener on 42932] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server listener on 42932
17:03:15.261 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server Responder
17:03:15.262 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ClientRMService is stopped.
17:03:15.262 [main] INFO  org.apache.hadoop.ipc.Server - Stopping server on 43008
17:03:15.268 [IPC Server listener on 43008] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server listener on 43008
17:03:15.269 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server Responder
17:03:15.270 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService is stopped.
17:03:15.270 [main] INFO  org.apache.hadoop.ipc.Server - Stopping server on 51462
17:03:15.274 [IPC Server listener on 51462] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server listener on 51462
17:03:15.274 [IPC Server Responder] INFO  org.apache.hadoop.ipc.Server - Stopping IPC Server Responder
17:03:15.275 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService is stopped.
17:03:15.275 [Ping Checker] INFO  o.a.h.y.u.AbstractLivelinessMonitor - NMLivelinessMonitor thread interrupted
17:03:15.276 [main] INFO  o.a.h.yarn.service.AbstractService - Service:NMLivelinessMonitor is stopped.
17:03:15.277 [ResourceManager Event Processor] ERROR o.a.h.y.s.r.ResourceManager - Returning, interrupted : java.lang.InterruptedException
17:03:15.278 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher is stopped.
17:03:15.278 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is stopped.
17:03:15.279 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer is stopped.
17:03:15.279 [main] INFO  o.a.h.yarn.service.AbstractService - Service:AMLivelinessMonitor is stopped.
17:03:15.279 [Ping Checker] INFO  o.a.h.y.u.AbstractLivelinessMonitor - AMLivelinessMonitor thread interrupted
17:03:15.280 [Ping Checker] INFO  o.a.h.y.u.AbstractLivelinessMonitor - AMLivelinessMonitor thread interrupted
17:03:15.280 [main] INFO  o.a.h.yarn.service.AbstractService - Service:AMLivelinessMonitor is stopped.
17:03:15.280 [Ping Checker] INFO  o.a.h.y.u.AbstractLivelinessMonitor - org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer thread interrupted
17:03:15.281 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer is stopped.
17:03:15.281 [main] INFO  o.a.h.yarn.service.AbstractService - Service:Dispatcher is stopped.
17:03:15.281 [main] INFO  o.a.h.yarn.service.AbstractService - Service:ResourceManager is stopped.
17:03:15.281 [main] INFO  o.a.h.yarn.service.AbstractService - Service:org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper is stopped.
17:03:15.281 [main] INFO  o.a.h.yarn.service.AbstractService - Service:com.yahoo.storm.yarn.TestIntegration is stopped.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 92.686 sec
Running com.yahoo.storm.yarn.TestStormMaster
17:03:16.298 [main] INFO  c.yahoo.storm.yarn.EmbeddedZKServer - Starting up embedded Zookeeper server
17:03:16.299 [main] INFO  o.a.zookeeper.server.ZooKeeperServer - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir ./target/zookeeper.data/version-2 snapdir ./target/zookeeper.data/version-2
17:03:16.299 [main] INFO  o.a.z.server.NIOServerCnxnFactory - binding to port 0.0.0.0/0.0.0.0:60000
17:03:16.299 [main] INFO  c.yahoo.storm.yarn.EmbeddedZKServer - Zookeeper port allocated:60000
17:03:16.300 [main] INFO  o.a.z.server.persistence.FileSnap - Reading snapshot ./target/zookeeper.data/version-2/snapshot.0
17:03:16.302 [main] INFO  o.a.z.s.persistence.FileTxnSnapLog - Snapshotting: 0
17:03:16.665 [main] INFO  com.yahoo.storm.yarn.TestStormMaster - Will be using storm found on PATH at ./lib/storm
17:03:16.679 [main] INFO  com.yahoo.storm.yarn.TestStormMaster - Storm server attaching to port: 9000
17:03:16.682 [main] INFO  c.y.s.yarn.StormMasterServerHandler - Storm master host:10.115.171.101
17:03:16.687 [main] INFO  com.yahoo.storm.yarn.MasterServer - launch nimbus
17:03:16.687 [main] INFO  c.y.s.yarn.StormMasterServerHandler - starting nimbus...
17:03:16.688 [main] INFO  com.yahoo.storm.yarn.MasterServer - launch ui
17:03:16.688 [main] INFO  c.y.s.yarn.StormMasterServerHandler - starting UI...
17:03:16.688 [main] INFO  com.yahoo.storm.yarn.MasterServer - launch 1 supervisors
17:03:16.688 [main] INFO  c.y.s.yarn.StormMasterServerHandler - adding 1 supervisors...
17:03:16.688 [main] INFO  com.yahoo.storm.yarn.StormAMRMClient - Added 1 supervisors, but not requesting containers now.
17:03:16.712 [Thread-288] INFO  c.y.s.yarn.StormMasterServerHandler - Running: java -server -Dstorm.home=./lib/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file=storm.yaml -cp conf:./lib/storm:./lib/storm/lib/*:./lib/storm/* -Xmx768m -Dlogback.configurationFile=./lib/storm/logback/cluster.xml -Dlogfile.name=ui.log backtype.storm.ui.core
17:03:16.715 [Thread-289] ERROR b.storm.security.auth.ThriftServer - ThriftServer is being stopped due to: org.apache.thrift7.transport.TTransportException: Could not create ServerSocket on address 0.0.0.0/0.0.0.0:9000.
org.apache.thrift7.transport.TTransportException: Could not create ServerSocket on address 0.0.0.0/0.0.0.0:9000.
at org.apache.thrift7.transport.TNonblockingServerSocket.<init>(TNonblockingServerSocket.java:89) ~[libthrift7-0.7.0.jar:0.7.0]
at org.apache.thrift7.transport.TNonblockingServerSocket.<init>(TNonblockingServerSocket.java:68) ~[libthrift7-0.7.0.jar:0.7.0]
at org.apache.thrift7.transport.TNonblockingServerSocket.<init>(TNonblockingServerSocket.java:61) ~[libthrift7-0.7.0.jar:0.7.0]
at backtype.storm.security.auth.SimpleTransportPlugin.getServer(SimpleTransportPlugin.java:47) ~[storm-core-0.9.0-wip17.jar:na]
at backtype.storm.security.auth.ThriftServer.serve(ThriftServer.java:52) ~[storm-core-0.9.0-wip17.jar:na]
at com.yahoo.storm.yarn.TestStormMaster$1.run(TestStormMaster.java:72) ~[test-classes/:na]
at java.lang.Thread.run(Thread.java:724) ~[na:1.7.0_25]
Exception in thread "main" java.lang.ExceptionInInitializerError
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:270)
at clojure.lang.RT.loadClassForName(RT.java:2056)
at clojure.lang.RT.load(RT.java:419)
at clojure.lang.RT.load(RT.java:400)
at clojure.core$load$fn__4890.invoke(core.clj:5415)
at clojure.core$load.doInvoke(core.clj:5414)
at clojure.lang.RestFn.invoke(RestFn.java:408)
at clojure.lang.Var.invoke(Var.java:415)
at backtype.storm.ui.core.<clinit>(Unknown Source)
Caused by: java.lang.RuntimeException: Could not find config file on classpath storm.yaml
at backtype.storm.utils.Utils.findAndReadConfigFile(Utils.java:111)
at backtype.storm.utils.Utils.readStormConfig(Utils.java:162)
at backtype.storm.config$read_storm_config.invoke(config.clj:66)
at backtype.storm.ui.core__init.load(Unknown Source)
at backtype.storm.ui.core__init.<clinit>(Unknown Source)
... 10 more

Results :

Tests run: 1, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ storm-yarn ---
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:45.228s
[INFO] Finished at: Wed Jul 10 17:03:19 PDT 2013
[INFO] Final Memory: 13M/187M
[INFO] ------------------------------------------------------------------------

Andy Feng

unread,
Jul 10, 2013, 9:16:07 PM7/10/13
to Bin Wang, storm...@googlegroups.com
java.io.IOException: Resource file:/root/workspace/storm-yarn/lib/storm.zip is not publicly accessable and as such cannot be part of the public cache.

What access permssion do you have for /root/workspace/storm-yarn/lib/storm.zip? Look like an issue related to file access permssion.

Andy 

Bin Wang

unread,
Jul 11, 2013, 1:39:24 PM7/11/13
to storm...@googlegroups.com, Bin Wang
-rwxrwxrwx 1 root root 15989166 Jul 10 14:07 /root/workspace/storm-yarn/lib/storm.zip

i logined as root user. before it's -rw-r--r-- 1 root root, should i change to other?

Andy Feng

unread,
Jul 11, 2013, 1:46:22 PM7/11/13
to Bin Wang, storm...@googlegroups.com
I would rather you build your package as a normal user, instead of "root".
Let's try to check pout code at your home directory, and run "mvn package".

--
You received this message because you are subscribed to the Google Groups "storm-yarn" group.
To unsubscribe from this group and stop receiving emails from it, send an email to storm-yarn+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

Bin Wang

unread,
Jul 11, 2013, 2:41:37 PM7/11/13
to storm...@googlegroups.com, Bin Wang
Thanks Andy.

I created a new normal user and pull the code and mvn again. Before add HADOOP, YARN etc to my environment. I meet below error:

11:26:53.693 [main] INFO  com.yahoo.storm.yarn.TestIntegration - bin/storm-yarn launch ./conf/storm.yaml --stormZip lib/storm.zip --appname storm-on-yarn-test --output target/appId.txt
bin/storm-yarn: line 19: yarn: command not found
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/cli/Options
at com.yahoo.storm.yarn.LaunchCommand.getOpts(LaunchCommand.java:34)
at com.yahoo.storm.yarn.Client.execute(Client.java:124)
at com.yahoo.storm.yarn.Client.main(Client.java:145)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.cli.Options
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 3 more
11:27:09.221 [main] ERROR com.yahoo.storm.yarn.TestIntegration - setup failure
java.io.FileNotFoundException: target/appId.txt (No such file or directory)


So i added hadoop, yarn stuff to my bashrc as below:
export HADOOP_HOME=/hadoop-2.0.4-alpha
export HADOOP_COMMON_HOME=${HADOOP_HOME}
export HADOOP_HDFS_HOME=${HADOOP_HOME}
export HADOOP_MAPRED_HOME=${HADOOP_HOME}
export HADOOP_YARN_HOME=${HADOOP_HOME}
export YARN_HOME=${HADOOP_HOME}
export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop
export YARN_CONF_DIR=${HADOOP_HOME}/etc/hadoop

But i failed again, the same error:
11:31:18.437 [Public Localizer] INFO  o.a.h.y.s.n.c.l.ResourceLocalizationService - Failed to download rsrc { { file:/home/binw/workspace/storm-yarn/lib/storm.zip, 1373566331000, ARCHIVE, null },pending,[(container_1373567468236_0001_01_000001)],263199359960907,DOWNLOADING}
java.io.IOException: Resource file:/home/binw/workspace/storm-yarn/lib/storm.zip is not publicly accessable and as such cannot be part of the public cache.
at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:184) ~[hadoop-yarn-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:280) ~[hadoop-yarn-common-2.0.4-alpha.jar:na]
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:51) ~[hadoop-yarn-common-2.0.4-alpha.jar:na]
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) ~[na:1.7.0_25]
at java.util.concurrent.FutureTask.run(FutureTask.java:166) ~[na:1.7.0_25]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_25]
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) ~[na:1.7.0_25]
at java.util.concurrent.FutureTask.run(FutureTask.java:166) ~[na:1.7.0_25]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_25]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ~[na:1.7.0_25]
at java.lang.Thread.run(Thread.java:724) ~[na:1.7.0_25]

-rwxrwxrwx 1 binw binw 15989166 Jul 11 11:12 /home/binw/workspace/storm-yarn/lib/storm.zip

here are some questions: when we build(mvn package) storm-yarn, what's the pre-setup installation?

1. Do we need a running HDFS or YARN?
2. If need, how can we tell storm-yarn when build it?

Thanks!

Zubair Nabi

unread,
Jul 24, 2013, 5:21:31 AM7/24/13
to storm...@googlegroups.com, Bin Wang
Hi guys,

I get the same error: "Failed tests:   com.yahoo.storm.yarn.TestIntegration: expected:<null> but was:<java.io.FileNotFoundException: target/appId.txt (No such file or directory)>". I've attached the complete trace from "mvn test".

Maven version:
Apache Maven 3.0.5 (r01de14724cdef164cd33c7c8c2fe155faf9602da; 2013-02-19 13:51:28+0000)
Maven home: /opt/maven
Java version: 1.7.0_25, vendor: Oracle Corporation
Java home: /usr/java/jdk1.7.0_25/jre
Default locale: en_GB, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-358.11.1.el6.x86_64", arch: "amd64", family: "unix"

YARN version:
Hadoop 0.23.9
Subversion https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23.9/hadoop-common-project/hadoop-common -r 1498472
Compiled by tgraves on Mon Jul  1 14:44:38 UTC 2013
From source with checksum 187fcd01f96ad016b0400952319dccdc

Thanks.

-Zubair
storm-yarn.log

Andy Feng

unread,
Jul 24, 2013, 1:10:37 PM7/24/13
to storm...@googlegroups.com, Bin Wang
Zubair:

Please use the latest branch hadoop-0.23 of storm-yarn. I have created a new pom files for 0.23 vs. cdh 4.3.
You should run the following command if you have hadoop 0.23 installed:
    mvn -f pom-0.23.xml clean package

Andy

Zubair Nabi

unread,
Jul 25, 2013, 4:01:54 AM7/25/13
to storm...@googlegroups.com, Bin Wang
Hi Andy,

Thank you very much for the reply. The tests run fine now.

-Zubair
Reply all
Reply to author
Forward
0 new messages