error starting up realtime node for the first time

99 views
Skip to first unread message

kadonn...@gmail.com

unread,
Jun 14, 2015, 4:08:01 PM6/14/15
to druid...@googlegroups.com
Hello,

I am wanting to learn more about Druid and started the tutorial on druid.io [http://druid.io/docs/0.7.3/Tutorial:-A-First-Look-at-Druid.html] but have immediately ran into issues starting up the node for the first time.  I am using Druid 0.7.3 with ZooKeeper 3.4.6 and am running locally on my macbook.  I cannot seem to find out what is going wrong and would appreciate any help or point in the right direction.

Thanks,
Kyle


2015-06-14T19:55:05,119 ERROR [main] io.druid.cli.CliBroker - Error when starting up.  Failing.

com.google.inject.ProvisionException: Guice provision errors:


1) Error injecting constructor, java.lang.NullPointerException

  at io.druid.guice.FireDepartmentsProvider.<init>(FireDepartmentsProvider.java:41)

  while locating io.druid.guice.FireDepartmentsProvider

  at io.druid.guice.RealtimeModule.configure(RealtimeModule.java:79)

  while locating java.util.List<io.druid.segment.realtime.FireDepartment>

    for parameter 0 at io.druid.segment.realtime.RealtimeManager.<init>(RealtimeManager.java:85)

  while locating io.druid.segment.realtime.RealtimeManager

  at io.druid.guice.RealtimeModule.configure(RealtimeModule.java:83)

  while locating io.druid.query.QuerySegmentWalker

    for parameter 3 at io.druid.server.QueryResource.<init>(QueryResource.java:89)

  while locating io.druid.server.QueryResource


1 error

at com.google.inject.internal.InjectorImpl$3.get(InjectorImpl.java:1014) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1036) ~[guice-4.0-beta.jar:?]

at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:134) ~[druid-api-0.3.8.jar:0.7.3]

at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:71) [druid-services-0.7.3.jar:0.7.3]

at io.druid.cli.ServerRunnable.run(ServerRunnable.java:38) [druid-services-0.7.3.jar:0.7.3]

at io.druid.cli.Main.main(Main.java:88) [druid-services-0.7.3.jar:0.7.3]

Caused by: java.lang.NullPointerException

at java.io.FileInputStream.<init>(FileInputStream.java:130) ~[?:1.8.0_25]

at com.fasterxml.jackson.core.JsonFactory.createParser(JsonFactory.java:708) ~[jackson-core-2.4.4.jar:2.4.4]

at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2122) ~[jackson-databind-2.4.4.jar:2.4.4]

at io.druid.guice.FireDepartmentsProvider.<init>(FireDepartmentsProvider.java:43) ~[druid-server-0.7.3.jar:0.7.3]

at io.druid.guice.FireDepartmentsProvider$$FastClassByGuice$$229da177.newInstance(<generated>) ~[guice-4.0-beta.jar:0.7.3]

at com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:61) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:108) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:88) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:269) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.BoundProviderFactory.get(BoundProviderFactory.java:62) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1058) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) ~[guice-4.0-beta.jar:?]

at com.google.inject.Scopes$1$1.get(Scopes.java:65) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:107) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:88) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:269) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:56) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1058) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) ~[guice-4.0-beta.jar:?]

at io.druid.guice.LifecycleScope$1.get(LifecycleScope.java:49) ~[druid-api-0.3.8.jar:0.7.3]

at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:107) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:88) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:269) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.InjectorImpl$3$1.call(InjectorImpl.java:1005) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1051) ~[guice-4.0-beta.jar:?]

at com.google.inject.internal.InjectorImpl$3.get(InjectorImpl.java:1001) ~[guice-4.0-beta.jar:?]

... 5 more

Fangjin

unread,
Jun 14, 2015, 4:20:42 PM6/14/15
to druid...@googlegroups.com
Hi Kyle, how did you start up the node? There seem to be things missing on the classpath.

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/6a4b7ec7-1111-4a62-a3d1-9c7f349a6333%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Kyle Donnelly

unread,
Jun 14, 2015, 4:53:06 PM6/14/15
to druid...@googlegroups.com
Output from my terminal is as follows:

mba:druid-0.7.3 mba$ ./run_example_server.sh

This will run a stand-alone version of Druid

Please specify an example by its number.

Examples available:

1 - twitter/twitter_realtime.spec - No Description

2 - wikipedia/wikipedia_realtime.spec - No Description

[1] > wikipedia/wikipedia_realtime.spec


--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/vxp7Hi2-HZA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+...@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.

Fangjin

unread,
Jun 14, 2015, 6:31:41 PM6/14/15
to druid...@googlegroups.com
Hi Kyle, do you have the full log when you start up?

Kyle Donnelly

unread,
Jun 14, 2015, 7:34:11 PM6/14/15
to druid-user

Here is the full output.



mba:druid-0.7.3 kadonnelly13$ ./run_example_server.sh

This will run a stand-alone version of Druid

Please specify an example by its number.

Examples available:

1 - twitter/twitter_realtime.spec - No Description

2 - wikipedia/wikipedia_realtime.spec - No Description

[1] > twitter/twitter_realtime.spec    

 

/Users/kadonnelly13/Desktop/druid-learn/druid-0.7.3/select_example.sh: line 35: twitter/twitter_realtime.spec: syntax error: invalid arithmetic operator (error token is ".spec")

usage: dirname path

Running command:

+ java -Xmx512m -Duser.timezone=UTC -Dfile.encoding=UTF-8 -Ddruid.realtime.specFile= -classpath '/Users/kadonnelly13/Desktop/druid-learn/druid-0.7.3/../config/realtime::/Users/kadonnelly13/Desktop/druid-learn/druid-0.7.3/config/_common:/Users/kadonnelly13/Desktop/druid-learn/druid-0.7.3/config/realtime:/Users/kadonnelly13/Desktop/druid-learn/druid-0.7.3/lib/*' io.druid.cli.Main example realtime

2015-06-14T20:51:41,525 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties

2015-06-14T20:51:41,535 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties

Jun 14, 2015 8:51:41 PM org.hibernate.validator.internal.util.Version <clinit>

INFO: HV000001: Hibernate Validator 5.1.3.Final

2015-06-14T20:51:42,883 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:druid-examples, io.druid.extensions:druid-kafka-eight, io.druid.extensions:mysql-metadata-storage], defaultVersion='0.7.3', localRepository='/Users/kadonnelly13/.m2/repository', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]

2015-06-14T20:51:43,218 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.cli.CliCommandCreator]

2015-06-14T20:51:45,481 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/io/druid/extensions/druid-examples/0.7.3/druid-examples-0.7.3.jar]

2015-06-14T20:51:45,482 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/org/twitter4j/twitter4j-core/3.0.3/twitter4j-core-3.0.3.jar]

2015-06-14T20:51:45,483 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/org/twitter4j/twitter4j-async/3.0.3/twitter4j-async-3.0.3.jar]

2015-06-14T20:51:45,483 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/org/twitter4j/twitter4j-stream/3.0.3/twitter4j-stream-3.0.3.jar]

2015-06-14T20:51:45,483 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/commons-validator/commons-validator/1.4.0/commons-validator-1.4.0.jar]

2015-06-14T20:51:45,484 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/commons-beanutils/commons-beanutils/1.8.3/commons-beanutils-1.8.3.jar]

2015-06-14T20:51:45,484 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]

2015-06-14T20:51:45,484 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar]

2015-06-14T20:51:45,503 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.cli.CliCommandCreator]

2015-06-14T20:51:45,762 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/io/druid/extensions/druid-kafka-eight/0.7.3/druid-kafka-eight-0.7.3.jar]

2015-06-14T20:51:45,762 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/org/apache/kafka/kafka_2.10/0.8.2.1/kafka_2.10-0.8.2.1.jar]

2015-06-14T20:51:45,763 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar]

2015-06-14T20:51:45,763 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar]

2015-06-14T20:51:45,764 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/org/apache/kafka/kafka-clients/0.8.2.1/kafka-clients-0.8.2.1.jar]

2015-06-14T20:51:45,764 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar]

2015-06-14T20:51:45,764 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/org/xerial/snappy/snappy-java/1.1.1.6/snappy-java-1.1.1.6.jar]

2015-06-14T20:51:45,764 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar]

2015-06-14T20:51:45,764 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar]

2015-06-14T20:51:45,764 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/log4j/log4j/1.2.16/log4j-1.2.16.jar]

2015-06-14T20:51:45,764 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/jline/jline/0.9.94/jline-0.9.94.jar]

2015-06-14T20:51:45,765 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar]

2015-06-14T20:51:45,765 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar]

2015-06-14T20:51:45,765 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/com/101tec/zkclient/0.3/zkclient-0.3.jar]

2015-06-14T20:51:45,796 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:mysql-metadata-storage] for class[io.druid.cli.CliCommandCreator]

2015-06-14T20:51:46,796 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/io/druid/extensions/mysql-metadata-storage/0.7.3/mysql-metadata-storage-0.7.3.jar]

2015-06-14T20:51:46,796 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/mysql/mysql-connector-java/5.1.34/mysql-connector-java-5.1.34.jar]

2015-06-14T20:51:46,796 INFO [main] io.druid.initialization.Initialization - Added URL[file:/Users/kadonnelly13/.m2/repository/org/jdbi/jdbi/2.32/jdbi-2.32.jar]

2015-06-14T20:51:47,417 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.initialization.DruidModule]

2015-06-14T20:51:47,424 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.examples.ExamplesDruidModule] for class[io.druid.initialization.DruidModule]

2015-06-14T20:51:47,425 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.initialization.DruidModule]

2015-06-14T20:51:47,428 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.firehose.kafka.KafkaEightDruidModule] for class[io.druid.initialization.DruidModule]

2015-06-14T20:51:47,428 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:mysql-metadata-storage] for class[io.druid.initialization.DruidModule]

2015-06-14T20:51:47,431 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.metadata.storage.mysql.MySQLMetadataStorageModule] for class[io.druid.initialization.DruidModule]

2015-06-14T20:51:49,184 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@41f4fe5]

2015-06-14T20:51:49,202 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]

2015-06-14T20:51:49,256 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='realtime', host='mba.home', port=8084}]

2015-06-14T20:51:49,389 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M}]

2015-06-14T20:51:49,404 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.RealtimeManagerConfig] from props[druid.realtime.] as [io.druid.guice.RealtimeManagerConfig@6bbe50c9]

2015-06-14T20:51:49,422 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [100000000] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]

2015-06-14T20:51:49,429 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]

2015-06-14T20:51:49,430 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]

2015-06-14T20:51:49,434 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]

2015-06-14T20:51:49,727 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@d8d9199]

2015-06-14T20:51:49,734 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@790a251b]

2015-06-14T20:51:49,742 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@3419e23b]

2015-06-14T20:51:49,788 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@6cd56321]

2015-06-14T20:51:49,789 ERROR [main] io.druid.cli.CliBroker - Error when starting up.  Failing.

mba:druid-0.7.3 kadonnelly13$ 


Fangjin

unread,
Jun 14, 2015, 7:44:57 PM6/14/15
to druid...@googlegroups.com

Hi kyle, what operating system r u using?

Kyle Donnelly

unread,
Jun 14, 2015, 7:46:52 PM6/14/15
to druid-user

charles.allen

unread,
Jun 22, 2015, 1:57:09 PM6/22/15
to druid...@googlegroups.com
Prompt is for numeric entry, not text entry. try 1 instead of twitter/twitter_realtime.spec
Reply all
Reply to author
Forward
0 new messages