Log Files - Log 4j problem

[laksh...@tokbox.com]

I am a big user of Camus. Trying to migrate to Gobblin and have been playing with Gobblin for the last few days. One major issue i am having is I am not able to see any log files.

This is how I run gobblin

$ cd gobblin-dist

gobblin-dist $ bin/gobblin-standalone.sh start --conf /Users/Documents/gobblin-dist/customconf --workdir /Users/Documents/gobblin-dist/work --logdir /Users/Documents/gobblin-dist/logs/

customconf is the directory where kafka.pull file resides.

I am trying to  pull data from kafka and I am running it in stand alone mode. I can see the output data files in the work dir. But I am not able to see any log files and everything is a black box now to me

When I start gobblin in standalone mode, I get this  "appending output to nohup.out".

When I look at the nohop.out file, I get the following

log4j:ERROR Could not create an Appender. Reported error follows.

java.lang.ClassNotFoundException: org.apache.log4j.rolling.RollingFileAppender

        at java.net.URLClassLoader$1.run(URLClassLoader.java:366)

        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

        at java.lang.ClassLoader.loadClass(ClassLoader.java:425)

        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)

        at java.lang.ClassLoader.loadClass(ClassLoader.java:358)

        at java.lang.Class.forName0(Native Method)

        at java.lang.Class.forName(Class.java:190)

        at org.apache.log4j.helpers.Loader.loadClass(Loader.java:198)

        at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:247)

        at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)

        at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)

        at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)

        at org.apache.log4j.xml.DOMConfigurator.parseRoot(DOMConfigurator.java:492)

        at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1006)

        at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:872)

        at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)

        at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)

        at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)

        at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:63)

        at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:329)

        at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:349)

        at gobblin.runtime.app.ServiceBasedAppLauncher.<clinit>(ServiceBasedAppLauncher.java:81)

log4j:WARN No appenders could be found for logger (org.quartz.impl.StdSchedulerFactory).

log4j:WARN Please initialize the log4j system properly.

log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

Inside my logs folder, I just have a file called gobblin-gc.log.

Any thoughts?

[Sahil Takiar]

You are hitting an issue with your classpath. Java can't find the log4j*.jar file. Are you following the directions in http://gobblin.readthedocs.org/en/latest/Getting-Started/ ?

You should have un-tarred the "gobblin-distribution.tar.gz" file. If you did there should be a "lib" directory inside of it. Is the log4j jar in the "lib" folder?

--
You received this message because you are subscribed to the Google Groups "gobblin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gobblin-user...@googlegroups.com.
To post to this group, send email to gobbli...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gobblin-users/e73f5f27-1b9d-47c7-aea0-8d27f2816bdb%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Sahil Takiar]

Can you pull the latest version of the code and try again, I think this was just fixed in: https://github.com/linkedin/gobblin/pull/860

On Wed, Mar 16, 2016 at 6:14 PM, Lakshmanan Muthuraman <laksh...@tokbox.com> wrote:

Thanks for responding.  I looked at the lib folder inside the untarred gobblin distribution. I find this file

log4j-1.2.17.jar. When gobblin starts up, I can also see that /Users/Documents/gobblin-dist/lib/log4j-1.2.17.jar is added to the class path.

--
You received this message because you are subscribed to a topic in the Google Groups "gobblin-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/gobblin-users/3sVqJjNVvPg/unsubscribe.
To unsubscribe from this group and all its topics, send an email to gobblin-user...@googlegroups.com.

To post to this group, send email to gobbli...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/gobblin-users/CAFfFnjTAWrpvGgJ2wf-PEoeseNn3LOYgGvHpYROojqvTcsJnXw%40mail.gmail.com.

[Lakshmanan Muthuraman]

Thanks. The latest pull fixed the problem for me.