Hogzilla not reporting to Graylog

[Gabriel Ortega]

Hi, I'm having some trouble while getting Hogzilla to work. I've run the stop-hogzilla.sh file and start-hogzilla.sh and when I check the /tmp/hogzilla.log file I'm getting the following output. Can somebody help me with this?

log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).

log4j:WARN Please initialize the log4j system properly.

log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties

17/10/03 10:48:43 INFO Client: Requesting a new application from cluster with 1 NodeManagers

17/10/03 10:48:43 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (8192 MB per container)

17/10/03 10:48:43 INFO Client: Will allocate AM container, with 1408 MB memory including 384 MB overhead

17/10/03 10:48:43 INFO Client: Setting up container launch context for our AM

17/10/03 10:48:43 INFO Client: Setting up the launch environment for our AM container

17/10/03 10:48:43 INFO Client: Preparing resources for our AM container

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/spark/lib/spark-assembly-1.6.3-hadoop2.6.0.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/Hogzilla.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-annotations-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-annotations-1.2.6-tests.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-client-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-common-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-common-1.2.6-tests.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-examples-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-hadoop2-compat-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-hadoop-compat-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-it-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-it-1.2.6-tests.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-prefix-tree-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-procedure-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-protocol-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-rest-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-server-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-server-1.2.6-tests.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-shell-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/hbase-thrift-1.2.6.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/htrace-core-3.1.0-incubating.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/guava-12.0.1.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/home/hogzilla/hbase/lib/metrics-core-2.2.0.jar

17/10/03 10:48:43 INFO Client: Source and destination file systems are the same. Not copying file:/tmp/spark-87e2b07f-aa40-4164-80cb-2d246e48514b/__spark_conf__770509300870631462.zip

17/10/03 10:48:43 INFO SecurityManager: Changing view acls to: root

17/10/03 10:48:43 INFO SecurityManager: Changing modify acls to: root

17/10/03 10:48:43 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); users with modify permissions: Set(root)

17/10/03 10:48:44 INFO Client: Submitting application 1 to ResourceManager

17/10/03 10:48:44 INFO YarnClientImpl: Submitted application application_1506984288288_0001

17/10/03 10:48:45 INFO Client: Application report for application_1506984288288_0001 (state: ACCEPTED)

17/10/03 10:48:45 INFO Client:

         client token: N/A

         diagnostics: N/A

         ApplicationMaster host: N/A

         ApplicationMaster RPC port: -1

         queue: default

         start time: 1507042124397

         final status: UNDEFINED

         tracking URL: http://debian:8088/proxy/application_1506984288288_0001/

         user: root

17/10/03 10:48:46 INFO Client: Application report for application_1506984288288_0001 (state: ACCEPTED)

17/10/03 10:48:47 INFO Client: Application report for application_1506984288288_0001 (state: FAILED)

17/10/03 10:48:47 INFO Client:

         client token: N/A

diagnostics: Application application_1506984288288_0001 failed 2 times due to AM Container for appattempt_1506984288288_0001_000002 exited with  exitCode: -1000

For more detailed output, check application tracking page:http://debian:8088/proxy/application_1506984288288_0001/Then, click on links to logs of each attempt.

Diagnostics: File file:/tmp/spark-87e2b07f-aa40-4164-80cb-2d246e48514b/__spark_conf__770509300870631462.zip does not exist

java.io.FileNotFoundException: File file:/tmp/spark-87e2b07f-aa40-4164-80cb-2d246e48514b/__spark_conf__770509300870631462.zip does not exist

        at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:539)

        at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:752)

        at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:529)

        at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:409)

        at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:251)

        at org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:61)

        at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:359)

        at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:357)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:422)

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)

        at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:356)

        at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:60)

        at java.util.concurrent.FutureTask.run(FutureTask.java:266)

        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

        at java.util.concurrent.FutureTask.run(FutureTask.java:266)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

Failing this attempt. Failing the application.

         ApplicationMaster host: N/A

         ApplicationMaster RPC port: -1

         queue: default

         start time: 1507042124397

         final status: FAILED

         tracking URL: http://debian:8088/cluster/app/application_1506984288288_0001

         user: root

Exception in thread "main" org.apache.spark.SparkException: Application application_1506984288288_0001 finished with failed status

        at org.apache.spark.deploy.yarn.Client.run(Client.scala:1034)

        at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1081)

        at org.apache.spark.deploy.yarn.Client.main(Client.scala)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:498)

        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)

        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)

        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)

        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)

        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

17/10/03 10:48:47 INFO ShutdownHookManager: Shutdown hook called

17/10/03 10:48:47 INFO ShutdownHookManager: Deleting directory /tmp/spark-87e2b07f-aa40-4164-80cb-2d246e48514b

Regards,

Gabriel

[Paulo Angelo]

Hi Gabriel,

Sorry for the delay on this reply.

Check if the files mentioned in the log does exist. For example, look for "/home/hogzilla/spark/lib/spark-assembly-1.6.3-hadoop2.6.0.jar".

Maybe you have a path problem. If so, change the script file start-hogzilla.sh to correct the file paths.

Let us know if you succeeded or not.

regards,

PA

--
You received this message because you are subscribed to the Google Groups "Hogzilla Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hogzilla+unsubscribe@googlegroups.com.
To post to this group, send email to hogz...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hogzilla/f8b02a47-1292-485d-aead-f7af780fcab0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.