I am trying to fetch data from Kfka to Hdfs using gobblin, Hadoop version (2.6.0)

409 views
Skip to first unread message

Kotesh Banoth

unread,
Apr 27, 2016, 8:15:25 AM4/27/16
to gobblin-users
1. After downloading the gobblin using the below command.

git clone https://github.com/linkedin/gobblin.git

2. I am using hadoop 2.6.0  so i used the below command

./gradlew clean build -PuseHadoop2 -PhadoopVersion=2.6.0  --stacktrace

Built executed Successfully showing : BUILD SUCCESSFUL

3. Now before Launching


bin/gobblin-standalone.sh start

I am supposed to provide setting in
vim gobblin-standalone.properties, which path should i give

# File system URIs
fs.uri=file:///
writer.fs.uri=${fs.uri}
state.store.fs.uri=${fs.uri}

Sahil Takiar

unread,
Apr 27, 2016, 7:13:25 PM4/27/16
to Kotesh Banoth, gobblin-users
Are you referring to the path in "fs.uri"? Typically, you don't need to specify a path, if you want to write to the local filesystem then setting "fs.uri=file:///" is sufficient. The final directory Gobblin will publish data to is controlled by "data.publisher.final.dir".

--Sahil

--
You received this message because you are subscribed to the Google Groups "gobblin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gobblin-user...@googlegroups.com.
To post to this group, send email to gobbli...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gobblin-users/3f62da5e-e4c1-4bed-a7cb-fc9412ed27cc%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Sahil Takiar

unread,
Apr 28, 2016, 12:54:43 PM4/28/16
to kotesh banoth, gobblin-users
You can follow http://gobblin.readthedocs.io/en/latest/Getting-Started/#run-your-first-job for a working end to end example.

On Thu, Apr 28, 2016 at 2:42 AM, kotesh banoth <kotes...@gmail.com> wrote:
Hi please can you help me out: nohup.out shows as below

Apr 28, 2016 12:29:35 PM com.google.common.util.concurrent.ServiceManager$ServiceListener failed
SEVERE: Service JobScheduler [FAILED] has failed in the STARTING state.
java.lang.RuntimeException: Found more than one .properties file in directory: /home/hadoop/gobblin/gobblin-dist/conf
    at gobblin.util.SchedulerUtils.loadJobConfigsRecursive(SchedulerUtils.java:192)
    at gobblin.util.SchedulerUtils.loadJobConfigs(SchedulerUtils.java:84)
    at gobblin.scheduler.JobScheduler.loadLocalJobConfigs(JobScheduler.java:377)
    at gobblin.scheduler.JobScheduler.scheduleLocallyConfiguredJobs(JobScheduler.java:366)
    at gobblin.scheduler.JobScheduler.startUp(JobScheduler.java:150)
    at com.google.common.util.concurrent.AbstractIdleService$2$1.run(AbstractIdleService.java:54)
    at com.google.common.util.concurrent.Callables$3.run(Callables.java:93)
    at java.lang.Thread.run(Thread.java:745)

Exception in thread "JobScheduler STARTING" Exception in thread "main" java.lang.RuntimeException: Found more than one .properties file in directory: /home/hadoop/gobblin/gobblin-dist/conf
    at gobblin.util.SchedulerUtils.loadJobConfigsRecursive(SchedulerUtils.java:192)
    at gobblin.util.SchedulerUtils.loadJobConfigs(SchedulerUtils.java:84)
    at gobblin.scheduler.JobScheduler.loadLocalJobConfigs(JobScheduler.java:377)
    at gobblin.scheduler.JobScheduler.scheduleLocallyConfiguredJobs(JobScheduler.java:366)
    at gobblin.scheduler.JobScheduler.startUp(JobScheduler.java:150)
    at com.google.common.util.concurrent.AbstractIdleService$2$1.run(AbstractIdleService.java:54)
    at com.google.common.util.concurrent.Callables$3.run(Callables.java:93)
    at java.lang.Thread.run(Thread.java:745)
java.lang.IllegalStateException: Expected to be healthy after starting
    at com.google.common.base.Preconditions.checkState(Preconditions.java:150)
    at com.google.common.util.concurrent.ServiceManager.awaitHealthy(ServiceManager.java:278)
    at gobblin.runtime.app.ServiceBasedAppLauncher.start(ServiceBasedAppLauncher.java:144)
    at gobblin.scheduler.SchedulerDaemon.main(SchedulerDaemon.java:63)
Apr 28, 2016 3:08:13 PM com.google.common.util.concurrent.ServiceManager$ServiceListener failed
SEVERE: Service JobScheduler [FAILED] has failed in the STARTING state.
java.lang.RuntimeException: Found more than one .properties file in directory: /home/hadoop/gobblin/gobblin-dist/conf
    at gobblin.util.SchedulerUtils.loadJobConfigsRecursive(SchedulerUtils.java:192)
    at gobblin.util.SchedulerUtils.loadJobConfigs(SchedulerUtils.java:84)
    at gobblin.scheduler.JobScheduler.loadLocalJobConfigs(JobScheduler.java:377)
    at gobblin.scheduler.JobScheduler.scheduleLocallyConfiguredJobs(JobScheduler.java:366)
    at gobblin.scheduler.JobScheduler.startUp(JobScheduler.java:150)
    at com.google.common.util.concurrent.AbstractIdleService$2$1.run(AbstractIdleService.java:54)
    at com.google.common.util.concurrent.Callables$3.run(Callables.java:93)
    at java.lang.Thread.run(Thread.java:745)

Exception in thread "JobScheduler STARTING" Exception in thread "main" java.lang.RuntimeException: Found more than one .properties file in directory: /home/hadoop/gobblin/gobblin-dist/conf
    at gobblin.util.SchedulerUtils.loadJobConfigsRecursive(SchedulerUtils.java:192)
    at gobblin.util.SchedulerUtils.loadJobConfigs(SchedulerUtils.java:84)
    at gobblin.scheduler.JobScheduler.loadLocalJobConfigs(JobScheduler.java:377)
    at gobblin.scheduler.JobScheduler.scheduleLocallyConfiguredJobs(JobScheduler.java:366)
    at gobblin.scheduler.JobScheduler.startUp(JobScheduler.java:150)
    at com.google.common.util.concurrent.AbstractIdleService$2$1.run(AbstractIdleService.java:54)
    at com.google.common.util.concurrent.Callables$3.run(Callables.java:93)
    at java.lang.Thread.run(Thread.java:745)
java.lang.IllegalStateException: Expected to be healthy after starting
    at com.google.common.base.Preconditions.checkState(Preconditions.java:150)
    at com.google.common.util.concurrent.ServiceManager.awaitHealthy(ServiceManager.java:278)
    at gobblin.runtime.app.ServiceBasedAppLauncher.start(ServiceBasedAppLauncher.java:144)
    at gobblin.scheduler.SchedulerDaemon.main(SchedulerDaemon.java:63)


Banoth Kotesh
Computer Science and Engineering(2010-14),
NIT Rourkela,

On Thu, Apr 28, 2016 at 9:48 AM, kotesh banoth <kotes...@gmail.com> wrote:
1   ./gradlew clean build -PuseHadoop2 -PhadoopVersion=2.6.0  --stacktrace

Pass 1: Analyzing classes (39 / 75) - 52% complete
Pass 1: Analyzing classes (75 / 75) - 100% complete
Pass 2: Analyzing classes (2 / 2) - 100% complete
Done with analysis
:gobblin-rest-service:gobblin-rest-server:compileTestJava
:gobblin-rest-service:gobblin-rest-server:processTestResources UP-TO-DATE
:gobblin-rest-service:gobblin-rest-server:testClasses
:gobblin-rest-service:gobblin-rest-server:findbugsTest
FindBugs rule violations were found. See the report at: file:///home/hadoop/Desktop/kafkHive/gobblin/build/gobblin-rest-server/reports/findbugs/test.xml
:gobblin-rest-service:gobblin-rest-server:test
:gobblin-rest-service:gobblin-rest-server:check
:gobblin-rest-service:gobblin-rest-server:build
:gobblin-utility:check
:gobblin-utility:build
:gobblin-runtime:check
:gobblin-runtime:build

BUILD SUCCESSFUL



2. hadoop@slave1:~/Desktop/kafkHive/gobblin$ bin/gobblin-standalone.sh start

Error: Environment variable GOBBLIN_JOB_CONFIG_DIR not set!

gobblin-standalone.sh <start | status | restart | stop> [OPTION]
Where OPTION can be:
  --workdir <job work dir>                       Gobblin's base work directory: if not set, taken from ${GOBBLIN_WORK_DIR}
  --fwdir <fwd dir>                              Gobblin's dist directory: if not set, taken from ${GOBBLIN_FWDIR}
  --logdir <log dir>                             Gobblin's log directory: if not set, taken from ${GOBBLIN_LOG_DIR}
  --jars <comma-separated list of job jars>      Job jar(s): if not set, /home/hadoop/Desktop/kafkHive/gobblin/lib is examined
  --conf <directory of job configuration files>  Directory of job configuration files: if not set, taken from
  --conffile <custom config file>                Custom config file: if not set, is ignored. Overwrites properties in /home/hadoop/Desktop/kafkHive/gobblin/conf/gobblin-standalone.properties
  --jvmflags <string of jvm flags>               String containing any additional JVM flags to include
  --help                                         Display this help and exit

Q: How can i over come this, Can you please help me??




Banoth Kotesh
Computer Science and Engineering(2010-14),
NIT Rourkela,

kotesh banoth

unread,
May 9, 2016, 8:55:42 AM5/9/16
to Sahil Takiar, gobblin-users
When i am starting Gobblin in standalone mode its showing like below:

bin/gobblin-standalone.sh: line 187: /home/hadoop/gobblin/gobblin-dist/work/job-output/.gobblin-pid: No such file or directory

~/gobblin/gobblin-dist$ nohup: appending output to ‘nohup.out'

Banoth Kotesh
Computer Science and Engineering(2010-14),
NIT Rourkela,

Sahil Takiar

unread,
May 9, 2016, 2:36:04 PM5/9/16
to kotesh banoth, gobblin-users
Does "/home/hadoop/gobblin/gobblin-dist/work/job-output/" exist? If "/home/hadoop/gobblin/gobblin-dist/work/job-output/.gobblin-pid" already exists try deleting and re-trying your flow.

Kotesh Banoth

unread,
May 10, 2016, 8:26:34 AM5/10/16
to gobblin-users, kotes...@gmail.com
When Running the bin/gobblin-standalone.sh start it is showing as below and nothing is written to nohup.out

hadoop@slave1:~/gobblin/gobblin-dist$ bin/gobblin-standalone.sh start
Starting Gobblin standalone daemon
Running command:
/usr/lib/jvm/java-7-openjdk-amd64/bin/java -Xmx2g -Xms1g -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintTenuringDistribution -XX:+UseCompressedOops -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/hadoop/gobblin/gobblin-dist/logs/ -Xloggc:/home/hadoop/gobblin/gobblin-dist/logs/gobblin-gc.log -Dgobblin.logs.dir=/home/hadoop/gobblin/gobblin-dist/logs -Dlog4j.configuration=file:///home/hadoop/gobblin/gobblin-dist/conf/log4j-standalone.xml -cp /home/hadoop/gobblin/gobblin-dist/lib/activation-1.1.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/annotations-2.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/ant-1.9.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/ant-launcher-1.9.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/antlr-runtime-3.5.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/aopalliance-1.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/apacheds-i18n-2.0.0-M15.jar:/home/hadoop/gobblin/gobblin-dist/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/hadoop/gobblin/gobblin-dist/lib/apache-log4j-extras-1.2.17.jar:/home/hadoop/gobblin/gobblin-dist/lib/api-asn1-api-1.0.0-M20.jar:/home/hadoop/gobblin/gobblin-dist/lib/api-util-1.0.0-M20.jar:/home/hadoop/gobblin/gobblin-dist/lib/asm-3.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/asm-commons-3.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/asm-tree-3.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/avro-1.7.7.jar:/home/hadoop/gobblin/gobblin-dist/lib/avro-ipc-1.7.7.jar:/home/hadoop/gobblin/gobblin-dist/lib/avro-ipc-1.7.7-tests.jar:/home/hadoop/gobblin/gobblin-dist/lib/avro-mapred-1.7.7-hadoop2.jar:/home/hadoop/gobblin/gobblin-dist/lib/azkaban-2.5.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/bcpg-jdk15on-1.52.jar:/home/hadoop/gobblin/gobblin-dist/lib/bcprov-jdk15on-1.52.jar:/home/hadoop/gobblin/gobblin-dist/lib/bonecp-0.8.0.RELEASE.jar:/home/hadoop/gobblin/gobblin-dist/lib/bsh-2.0b4.jar:/home/hadoop/gobblin/gobblin-dist/lib/c3p0-0.9.1.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/calcite-avatica-1.2.0-incubating.jar:/home/hadoop/gobblin/gobblin-dist/lib/calcite-core-1.2.0-incubating.jar:/home/hadoop/gobblin/gobblin-dist/lib/calcite-linq4j-1.2.0-incubating.jar:/home/hadoop/gobblin/gobblin-dist/lib/cglib-nodep-2.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/codemodel-2.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-cli-1.3.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-codec-1.10.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-collections-3.2.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-compiler-2.7.6.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-compress-1.10.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-configuration-1.10.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-daemon-1.0.13.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-dbcp-1.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-el-1.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-email-1.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-httpclient-3.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-io-2.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-lang-2.6.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-lang3-3.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-logging-1.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-math3-3.5.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-net-3.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-pool-1.5.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-pool2-2.4.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/commons-vfs2-2.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/config-1.2.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/curator-client-2.10.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/curator-framework-2.10.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/curator-recipes-2.10.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/d2-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/data-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/datanucleus-api-jdo-3.2.6.jar:/home/hadoop/gobblin/gobblin-dist/lib/datanucleus-core-3.2.10.jar:/home/hadoop/gobblin/gobblin-dist/lib/datanucleus-rdbms-3.2.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/data-transform-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/degrader-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/derby-10.12.1.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/eigenbase-properties-1.1.5.jar:/home/hadoop/gobblin/gobblin-dist/lib/generator-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/geronimo-jaspic_1.0_spec-1.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/geronimo-jpa_3.0_spec-1.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/geronimo-jta_1.1_spec-1.1.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-admin-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-api-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-azkaban-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-compaction-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-config-client-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-config-core-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-core-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-data-management-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-example-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-hadoop2-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-hive-registration-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-metastore-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-metrics-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-rest-api-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-rest-api-data-template-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-rest-api-rest-client-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-rest-client-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-rest-server-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-runtime-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-test-harness-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-tunnel-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-utility-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/gobblin-yarn-0.6.2-416-g08f341b.jar:/home/hadoop/gobblin/gobblin-dist/lib/groovy-all-2.1.6.jar:/home/hadoop/gobblin/gobblin-dist/lib/gson-2.6.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/guava-15.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/guice-4.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/guice-servlet-3.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hadoop-annotations-2.6.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hadoop-auth-2.6.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hadoop-common-2.6.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hadoop-hdfs-2.6.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hadoop-mapreduce-client-common-2.6.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hadoop-mapreduce-client-core-2.6.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hadoop-yarn-api-2.6.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hadoop-yarn-client-2.6.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hadoop-yarn-common-2.6.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hadoop-yarn-server-common-2.6.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/hamcrest-core-1.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/helix-core-0.6.6-SNAPSHOT.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-ant-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-common-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-exec-1.0.1-core.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-jdbc-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-metastore-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-serde-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-service-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-shims-0.20-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-shims-0.20S-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-shims-0.23-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-shims-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-shims-common-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/hive-shims-common-secure-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/htrace-core-3.0.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/httpclient-4.5.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/httpcore-4.4.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/influxdb-java-2.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/jackson-annotations-2.2.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/jackson-core-2.2.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/gobblin/gobblin-dist/lib/jackson-databind-2.2.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/gobblin/gobblin-dist/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/gobblin/gobblin-dist/lib/jackson-xc-1.9.13.jar:/home/hadoop/gobblin/gobblin-dist/lib/janino-2.7.6.jar:/home/hadoop/gobblin/gobblin-dist/lib/jansi-1.11.jar:/home/hadoop/gobblin/gobblin-dist/lib/jasper-compiler-5.5.23.jar:/home/hadoop/gobblin/gobblin-dist/lib/jasper-runtime-5.5.23.jar:/home/hadoop/gobblin/gobblin-dist/lib/jasypt-1.9.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/javassist-3.18.2-GA.jar:/home/hadoop/gobblin/gobblin-dist/lib/javax.inject-1.jar:/home/hadoop/gobblin/gobblin-dist/lib/javax.mail-1.5.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/java-xmlbuilder-0.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/javax.servlet-api-3.1.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/jaxb-api-2.2.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/gobblin/gobblin-dist/lib/jcommander-1.48.jar:/home/hadoop/gobblin/gobblin-dist/lib/jdo2-api-2.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/jdo-api-3.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/jersey-client-1.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/jersey-core-1.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/jersey-guice-1.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/jersey-json-1.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/jersey-server-1.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/jets3t-0.9.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/jettison-1.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/jetty-6.1.26.jar:/home/hadoop/gobblin/gobblin-dist/lib/jetty-all-7.6.0.v20120127.jar:/home/hadoop/gobblin/gobblin-dist/lib/jetty-http-9.2.14.v20151106.jar:/home/hadoop/gobblin/gobblin-dist/lib/jetty-io-9.2.14.v20151106.jar:/home/hadoop/gobblin/gobblin-dist/lib/jetty-security-9.2.14.v20151106.jar:/home/hadoop/gobblin/gobblin-dist/lib/jetty-server-9.2.14.v20151106.jar:/home/hadoop/gobblin/gobblin-dist/lib/jetty-servlet-9.2.14.v20151106.jar:/home/hadoop/gobblin/gobblin-dist/lib/jetty-util-6.1.26.jar:/home/hadoop/gobblin/gobblin-dist/lib/jetty-util-9.2.14.v20151106.jar:/home/hadoop/gobblin/gobblin-dist/lib/jline-0.9.94.jar:/home/hadoop/gobblin/gobblin-dist/lib/joda-time-2.9.3.jar:/home/hadoop/gobblin/gobblin-dist/lib/jopt-simple-3.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/jpam-1.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/jsch-0.1.53.jar:/home/hadoop/gobblin/gobblin-dist/lib/json-20070829.jar:/home/hadoop/gobblin/gobblin-dist/lib/jsp-api-2.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/jsr305-3.0.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/jta-1.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/junit-3.8.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/kafka_2.11-0.8.2.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/kafka-clients-0.8.2.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/leveldbjni-all-1.8.jar:/home/hadoop/gobblin/gobblin-dist/lib/libfb303-0.9.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/libthrift-0.9.3.jar:/home/hadoop/gobblin/gobblin-dist/lib/li-jersey-uri-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/log4j-1.2.17.jar:/home/hadoop/gobblin/gobblin-dist/lib/lombok-1.16.8.jar:/home/hadoop/gobblin/gobblin-dist/lib/lz4-1.2.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/mail-1.4.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/maven-scm-api-1.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/maven-scm-provider-svn-commons-1.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/maven-scm-provider-svnexe-1.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/metrics-core-2.2.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/metrics-core-3.1.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/metrics-graphite-3.1.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/metrics-jvm-3.1.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/mina-core-1.1.7.jar:/home/hadoop/gobblin/gobblin-dist/lib/mockito-core-1.10.19.jar:/home/hadoop/gobblin/gobblin-dist/lib/mysql-connector-java-6.0.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/netty-3.2.3.Final.jar:/home/hadoop/gobblin/gobblin-dist/lib/netty-3.7.0.Final.jar:/home/hadoop/gobblin/gobblin-dist/lib/objenesis-2.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/okhttp-2.4.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/okio-1.4.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/opencsv-2.3.jar:/home/hadoop/gobblin/gobblin-dist/lib/paranamer-2.3.jar:/home/hadoop/gobblin/gobblin-dist/lib/parseq-1.3.6.jar:/home/hadoop/gobblin/gobblin-dist/lib/pegasus-common-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/home/hadoop/gobblin/gobblin-dist/lib/plexus-utils-1.5.6.jar:/home/hadoop/gobblin/gobblin-dist/lib/protobuf-java-2.5.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/quartz-2.2.3.jar:/home/hadoop/gobblin/gobblin-dist/lib/r2-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/reflections-0.9.10.jar:/home/hadoop/gobblin/gobblin-dist/lib/regexp-1.3.jar:/home/hadoop/gobblin/gobblin-dist/lib/restli-client-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/restli-common-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/restli-docgen-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/restli-netty-standalone-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/restli-server-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/restli-tools-1.15.9.jar:/home/hadoop/gobblin/gobblin-dist/lib/retrofit-1.9.0.jar:/home/hadoop/gobblin/gobblin-dist/lib/scala-library-2.11.8.jar:/home/hadoop/gobblin/gobblin-dist/lib/scala-parser-combinators_2.11-1.0.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/scala-xml_2.11-1.0.2.jar:/home/hadoop/gobblin/gobblin-dist/lib/servlet-api-2.5-20081211.jar:/home/hadoop/gobblin/gobblin-dist/lib/servlet-api-2.5.jar:/home/hadoop/gobblin/gobblin-dist/lib/slf4j-api-1.7.21.jar:/home/hadoop/gobblin/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar:/home/hadoop/gobblin/gobblin-dist/lib/snappy-0.3.jar:/home/hadoop/gobblin/gobblin-dist/lib/snappy-java-1.1.1.7.jar:/home/hadoop/gobblin/gobblin-dist/lib/ST4-4.0.4.jar:/home/hadoop/gobblin/gobblin-dist/lib/stax-api-1.0.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/stax-api-1.0-2.jar:/home/hadoop/gobblin/gobblin-dist/lib/testng-6.9.10.jar:/home/hadoop/gobblin/gobblin-dist/lib/transaction-api-1.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/velocity-1.7.jar:/home/hadoop/gobblin/gobblin-dist/lib/xercesImpl-2.9.1.jar:/home/hadoop/gobblin/gobblin-dist/lib/xmlenc-0.52.jar:/home/hadoop/gobblin/gobblin-dist/lib/zkclient-0.3.jar:/home/hadoop/gobblin/gobblin-dist/lib/zookeeper-3.4.6.jar:/home/hadoop/gobblin/gobblin-dist/conf -Dorg.quartz.properties=/home/hadoop/gobblin/gobblin-dist/conf/quartz.properties  gobblin.scheduler.SchedulerDaemon /home/hadoop/gobblin/gobblin-dist/conf/gobblin-standalone.properties
hadoop@slave1:~/gobblin/gobblin-dist$ nohup: appending output to ‘nohup.out’

hadoop@slave1:~/gobblin/gobblin-dist$

Sahil Takiar

unread,
May 10, 2016, 11:28:50 AM5/10/16
to Kotesh Banoth, gobblin-users
Logs get sent into the file "./logs/gobblin-current.log". The location is based on where you launch the "gobblin-standalone.sh" script.

--
You received this message because you are subscribed to the Google Groups "gobblin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gobblin-user...@googlegroups.com.
To post to this group, send email to gobbli...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages