Run Your First Job failed

49 views
Skip to first unread message

Zhenhua Cao

unread,
May 12, 2016, 1:08:45 AM5/12/16
to gobblin-users
the error about run the first gobblin job, I can't  find the way to the error. 

richard@parllay:~/source/java/gobblin/gobblin-dist$ ./bin/gobblin-standalone.sh --workdir=/home/richard/source/java/gobblin/gobblin-dist/work --conf /home/richard/source/java/gobblin/gobblin-dist/conf start
richard@parllay:~/source/java/gobblin/gobblin-dist$ ll
总用量 40
drwxr-xr-x  7 richard richard  4096 5月  12 13:03 ./
drwxrwxr-x 36 richard richard  4096 5月  12 12:55 ../
drwxr-xr-x  2 richard richard  4096 5月  12 12:48 bin/
drwxr-xr-x  3 richard richard  4096 5月  12 13:01 conf/
drwxr-xr-x  2 richard richard 12288 5月  12 12:48 lib/
drwxrwxr-x  2 richard richard  4096 5月  12 12:59 logs/
-rw-------  1 richard richard  2092 5月  12 13:01 nohup.out
drwxrwxr-x  2 richard richard  4096 5月  12 12:57 work/
richard@parllay:~/source/java/gobblin/gobblin-dist$ ll work/
总用量 12
drwxrwxr-x 2 richard richard 4096 5月  12 12:57 ./
drwxr-xr-x 7 richard richard 4096 5月  12 13:03 ../
-rw-rw-r-- 1 richard richard 1278 5月  12 12:57 job.pull
richard@parllay:~/source/java/gobblin/gobblin-dist$ ll conf/
总用量 44
drwxr-xr-x 3 richard richard 4096 5月  12 13:01 ./
drwxr-xr-x 7 richard richard 4096 5月  12 13:03 ../
-rwxrwxr-x 1 richard richard 1463 5月  12 11:26 gobblin-mapreduce.properties.bak*
-rwxrwxr-x 1 richard richard 1609 5月  12 11:26 gobblin-standalone.properties*
-rwxrwxr-x 1 richard richard 1099 5月  12 11:26 log4j-compaction.xml*
-rwxrwxr-x 1 richard richard 1457 5月  12 11:26 log4j-mapreduce.xml*
-rwxrwxr-x 1 richard richard  331 5月  12 11:26 log4j.properties.bak*
-rwxrwxr-x 1 richard richard 1024 5月  12 11:26 log4j-standalone.xml*
-rwxrwxr-x 1 richard richard  581 5月  12 11:26 log4j.xml*
-rwxrwxr-x 1 richard richard  149 5月  12 11:26 quartz.properties*
drwxrwxr-x 2 richard richard 4096 5月  12 11:26 yarn/
richard@parllay:~/source/java/gobblin/gobblin-dist$ 


vim nohup.out

java.lang.RuntimeException: Found more than one .properties file in directory: /home/richard/source/java/gobblin/gobblin-dist/conf
        at gobblin.util.SchedulerUtils.loadJobConfigsRecursive(SchedulerUtils.java:192)
        at gobblin.util.SchedulerUtils.loadJobConfigs(SchedulerUtils.java:84)
        at gobblin.scheduler.JobScheduler.loadLocalJobConfigs(JobScheduler.java:377)
        at gobblin.scheduler.JobScheduler.scheduleLocallyConfiguredJobs(JobScheduler.java:366)
        at gobblin.scheduler.JobScheduler.startUp(JobScheduler.java:150)
        at com.google.common.util.concurrent.AbstractIdleService$2$1.run(AbstractIdleService.java:54)
        at com.google.common.util.concurrent.Callables$3.run(Callables.java:93)
        at java.lang.Thread.run(Thread.java:744)

Exception in thread "JobScheduler STARTING" java.lang.RuntimeException: Found more than one .properties file in directory: /home/richard/source/java/gobblin/gobblin-dist/conf
        at gobblin.util.SchedulerUtils.loadJobConfigsRecursive(SchedulerUtils.java:192)
        at gobblin.util.SchedulerUtils.loadJobConfigs(SchedulerUtils.java:84)
        at gobblin.scheduler.JobScheduler.loadLocalJobConfigs(JobScheduler.java:377)
        at gobblin.scheduler.JobScheduler.scheduleLocallyConfiguredJobs(JobScheduler.java:366)
        at gobblin.scheduler.JobScheduler.startUp(JobScheduler.java:150)
        at com.google.common.util.concurrent.AbstractIdleService$2$1.run(AbstractIdleService.java:54)
        at com.google.common.util.concurrent.Callables$3.run(Callables.java:93)
        at java.lang.Thread.run(Thread.java:744)
Exception in thread "main" java.lang.IllegalStateException: Expected to be healthy after starting
        at com.google.common.base.Preconditions.checkState(Preconditions.java:150)
        at com.google.common.util.concurrent.ServiceManager.awaitHealthy(ServiceManager.java:278)
        at gobblin.runtime.app.ServiceBasedAppLauncher.start(ServiceBasedAppLauncher.java:144)
        at gobblin.scheduler.SchedulerDaemon.main(SchedulerDaemon.java:63)


vim gobblin-current.log

2016-05-12 12:59:15 CST INFO  [main] org.quartz.impl.StdSchedulerFactory  1172 - Using default implementation for ThreadExecutor
2016-05-12 12:59:15 CST INFO  [main] org.quartz.core.SchedulerSignalerImpl  61 - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
2016-05-12 12:59:15 CST INFO  [main] org.quartz.core.QuartzScheduler  240 - Quartz Scheduler v.2.2.3 created.
2016-05-12 12:59:15 CST INFO  [main] org.quartz.simpl.RAMJobStore  155 - RAMJobStore initialized.
2016-05-12 12:59:15 CST INFO  [main] org.quartz.core.QuartzScheduler  305 - Scheduler meta-data: Quartz Scheduler (v2.2.3) 'LocalJobScheduler' with instanceId 'NON_CLUSTERED'
  Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally.
  NOT STARTED.
  Currently in standby mode.
  Number of jobs executed: 0
  Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 3 threads.
  Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered.

2016-05-12 12:59:15 CST INFO  [main] org.quartz.impl.StdSchedulerFactory  1327 - Quartz scheduler 'LocalJobScheduler' initialized from specified file: '/home/richard/source/java/gobblin/gobblin-dist/conf/quartz.properties'
2016-05-12 12:59:15 CST INFO  [main] org.quartz.impl.StdSchedulerFactory  1331 - Quartz scheduler version: 2.2.3
2016-05-12 12:59:16 CST INFO  [main] gobblin.runtime.app.ServiceBasedAppLauncher  141 - Starting the Gobblin application and all its associated Services
2016-05-12 12:59:16 CST INFO  [JobScheduler STARTING] gobblin.scheduler.JobScheduler  146 - Starting the job scheduler
2016-05-12 12:59:16 CST INFO  [JobScheduler STARTING] org.quartz.core.QuartzScheduler  575 - Scheduler LocalJobScheduler_$_NON_CLUSTERED started.
2016-05-12 12:59:16 CST INFO  [JobScheduler STARTING] gobblin.scheduler.JobScheduler  365 - Scheduling locally configured jobs
2016-05-12 13:00:44 CST INFO  [main] org.quartz.impl.StdSchedulerFactory  1172 - Using default implementation for ThreadExecutor
2016-05-12 13:00:44 CST INFO  [main] org.quartz.core.SchedulerSignalerImpl  61 - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
2016-05-12 13:00:44 CST INFO  [main] org.quartz.core.QuartzScheduler  240 - Quartz Scheduler v.2.2.3 created.
2016-05-12 13:00:44 CST INFO  [main] org.quartz.simpl.RAMJobStore  155 - RAMJobStore initialized.
2016-05-12 13:00:44 CST INFO  [main] org.quartz.core.QuartzScheduler  305 - Scheduler meta-data: Quartz Scheduler (v2.2.3) 'LocalJobScheduler' with instanceId 'NON_CLUSTERED'
  Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally.
  NOT STARTED.
  Currently in standby mode.
  Number of jobs executed: 0
  Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 3 threads.
  Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered.

2016-05-12 13:00:44 CST INFO  [main] org.quartz.impl.StdSchedulerFactory  1327 - Quartz scheduler 'LocalJobScheduler' initialized from specified file: '/home/richard/source/java/gobblin/gobblin-dist/conf/quartz.properties'
2016-05-12 13:00:44 CST INFO  [main] org.quartz.impl.StdSchedulerFactory  1331 - Quartz scheduler version: 2.2.3
2016-05-12 13:00:44 CST INFO  [main] gobblin.runtime.app.ServiceBasedAppLauncher  141 - Starting the Gobblin application and all its associated Services
2016-05-12 13:00:44 CST INFO  [JobScheduler STARTING] gobblin.scheduler.JobScheduler  146 - Starting the job scheduler
2016-05-12 13:00:44 CST INFO  [JobScheduler STARTING] org.quartz.core.QuartzScheduler  575 - Scheduler LocalJobScheduler_$_NON_CLUSTERED started.
2016-05-12 13:00:44 CST INFO  [JobScheduler STARTING] gobblin.scheduler.JobScheduler  365 - Scheduling locally configured jobs
2016-05-12 13:01:36 CST INFO  [main] org.quartz.impl.StdSchedulerFactory  1172 - Using default implementation for ThreadExecutor
2016-05-12 13:01:36 CST INFO  [main] org.quartz.core.SchedulerSignalerImpl  61 - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
2016-05-12 13:01:36 CST INFO  [main] org.quartz.core.QuartzScheduler  240 - Quartz Scheduler v.2.2.3 created.
2016-05-12 13:01:36 CST INFO  [main] org.quartz.simpl.RAMJobStore  155 - RAMJobStore initialized.
2016-05-12 13:01:36 CST INFO  [main] org.quartz.core.QuartzScheduler  305 - Scheduler meta-data: Quartz Scheduler (v2.2.3) 'LocalJobScheduler' with instanceId 'NON_CLUSTERED'
  Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally.
  NOT STARTED.
  Currently in standby mode.
  Number of jobs executed: 0
  Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 3 threads.
  Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered.

2016-05-12 13:01:36 CST INFO  [main] org.quartz.impl.StdSchedulerFactory  1327 - Quartz scheduler 'LocalJobScheduler' initialized from specified file: '/home/richard/source/java/gobblin/gobblin-dist/conf/quartz.properties'
2016-05-12 13:01:36 CST INFO  [main] org.quartz.impl.StdSchedulerFactory  1331 - Quartz scheduler version: 2.2.3
2016-05-12 13:01:36 CST INFO  [main] gobblin.runtime.app.ServiceBasedAppLauncher  141 - Starting the Gobblin application and all its associated Services
2016-05-12 13:01:36 CST INFO  [JobScheduler STARTING] gobblin.scheduler.JobScheduler  146 - Starting the job scheduler
2016-05-12 13:01:36 CST INFO  [JobScheduler STARTING] org.quartz.core.QuartzScheduler  575 - Scheduler LocalJobScheduler_$_NON_CLUSTERED started.
2016-05-12 13:01:36 CST INFO  [JobScheduler STARTING] gobblin.scheduler.JobScheduler  365 - Scheduling locally configured jobs









Sahil Takiar

unread,
May 12, 2016, 11:54:37 AM5/12/16
to Zhenhua Cao, gobblin-users
The "--conf" parameter is suppose to point to a directory containing Gobblin ".job" files. Try taking a look at the Getting Started guide: http://gobblin.readthedocs.io/en/latest/Getting-Started/

It has step by step directions on how to launch a Gobblin job.

--
You received this message because you are subscribed to the Google Groups "gobblin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gobblin-user...@googlegroups.com.
To post to this group, send email to gobbli...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gobblin-users/e0c9c01d-4493-4106-b8f6-e4f758ce48da%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages