Not enough direct memory. Please adjust -XX:MaxDirectMemorySize or druid.computation.buffer.size: maxDirectMemory[249,364,480], memoryNeeded[536,870,912], druid.computation.buffer.size[268,435,456]

[David Montgomery]

Hi

I am using as much as possible the config file from the online docs.  Overloard is on a node with 1 gig of ram yet I get the below error.  It provides this recomednation
maxDirectMemory[249,364,480], memoryNeeded[536,870,912], druid.computation.buffer.size[268,435,456]

what do I put in the runtime.properties file?

curl -X 'POST' -H 'Content-Type:application/json' -d @examples/indexing/wikipedia_index_task.json 107.170.226.65:8082/druid/indexer/v1/task
{"task":"index_wikipedia_2014-03-06T05:57:19.192Z"}

This is for the overlord node runtime.properties:

-server
-Xmx256m
-Duser.timezone=UTC
-Dfile.encoding=UTF-8

druid.host=<%=@druid_host%>
druid.port=<%=@host_port%>
druid.service=overlord

druid.zk.service.host=<%= "#{@zookeeper.values.join(':2181, ')}:2181" %>

druid.db.connector.connectURI=jdbc:mysql://<%=@mysql_host%>:3306/<%=@mysql_database%>
druid.db.connector.user=<%=@mysql_username%>
druid.db.connector.password=<%=@mysql_password%>

druid.selectors.indexing.serviceName=overlord
druid.indexer.queue.startDelay=PT0M
druid.indexer.runner.javaOpts="-server -Xmx1g"
druid.indexer.runner.startPort=<%=@host_port%>
druid.indexer.fork.property.druid.computation.buffer.size=268435456




2014-03-06 05:57:20,394 INFO [main] io.druid.server.initialization.PropertiesModule - Loading properties from runtime.properties
2014-03-06 05:57:20,468 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.0.1.Final
2014-03-06 05:57:21,342 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[], localRepository='/root/.m2/repository', remoteRepositories=[http://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2014-03-06 05:57:23,180 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2014-03-06 05:57:23,343 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@37ceb547]
2014-03-06 05:57:23,402 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
2014-03-06 05:57:23,470 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='overlord', host='107.170.226.65:8082', port=8082}]
2014-03-06 05:57:23,638 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@5cbacbb]
2014-03-06 05:57:23,662 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.HttpClientModule$DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.HttpClientModule$DruidHttpClientConfig@74a9ba28]
2014-03-06 05:57:23,791 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@fa0784f]
2014-03-06 05:57:23,794 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1.dzk.do.development.singapore.rtbhui.com:2181] for [druid.zk.service.host] on [io.druid.curator.CuratorConfig#getZkHosts()]
2014-03-06 05:57:23,802 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [30000] for [druid.zk.service.sessionTimeoutMs] on [io.druid.curator.CuratorConfig#getZkSessionTimeoutMs()]
2014-03-06 05:57:23,802 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [false] for [druid.curator.compress] on [io.druid.curator.CuratorConfig#enableCompression()]
2014-03-06 05:57:23,914 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2014-03-06 05:57:23,990 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@164ef200]
2014-03-06 05:57:24,330 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@564d088e]
2014-03-06 05:57:24,337 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.segment.loading.LocalDataSegmentPusherConfig@69824fe7]
2014-03-06 05:57:24,367 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@69b28a51]
2014-03-06 05:57:24,368 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.liveSegmentsPath] on [io.druid.server.initialization.ZkPathsConfig#getLiveSegmentsPath()]
2014-03-06 05:57:24,369 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.base] on [io.druid.server.initialization.ZkPathsConfig#getZkBasePath()]
2014-03-06 05:57:24,369 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.announcementsPath] on [io.druid.server.initialization.ZkPathsConfig#getAnnouncementsPath()]
2014-03-06 05:57:24,369 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.loadQueuePath] on [io.druid.server.initialization.ZkPathsConfig#getLoadQueuePath()]
2014-03-06 05:57:24,369 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.propertiesPath] on [io.druid.server.initialization.ZkPathsConfig#getPropertiesPath()]
2014-03-06 05:57:24,369 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.tasksPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerTaskPath()]
2014-03-06 05:57:24,370 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.statusPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerStatusPath()]
2014-03-06 05:57:24,370 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.servedSegmentsPath] on [io.druid.server.initialization.ZkPathsConfig#getServedSegmentsPath()]
2014-03-06 05:57:24,370 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.leaderLatchPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerLeaderLatchPath()]
2014-03-06 05:57:24,370 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.coordinatorPath] on [io.druid.server.initialization.ZkPathsConfig#getCoordinatorPath()]
2014-03-06 05:57:24,371 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.announcementsPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerAnnouncementPath()]
2014-03-06 05:57:24,454 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@4acaef4c]
2014-03-06 05:57:24,461 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.LegacyDataSegmentAnnouncerProvider@353e8c11]
2014-03-06 05:57:24,470 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.ServerInventoryViewProvider] from props[druid.announcer.] as [io.druid.client.SingleServerInventoryProvider@2c90d810]
2014-03-06 05:57:24,480 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.QueryConfig] from props[druid.query.] as [io.druid.query.QueryConfig@373a98f7]
2014-03-06 05:57:24,498 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@4f96fdc]
2014-03-06 05:57:24,512 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@be0b841]
2014-03-06 05:57:24,513 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [268435456] for [druid.computation.buffer.size] on [io.druid.server.DruidProcessingConfig#intermediateComputeSizeBytes()]
2014-03-06 05:57:24,514 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
2014-03-06 05:57:24,515 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [1] for [${base_path}.numThreads] on [com.metamx.common.concurrent.ExecutorServiceConfig#getNumThreads()]
2014-03-06 05:57:24,531 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@564df01d]
2014-03-06 05:57:24,532 ERROR [main] io.druid.cli.CliPeon - Error when starting up.  Failing.
com.google.inject.ProvisionException: Guice provision errors:

1) Not enough direct memory.  Please adjust -XX:MaxDirectMemorySize or druid.computation.buffer.size: maxDirectMemory[249,364,480], memoryNeeded[536,870,912], druid.computation.buffer.size[268,435,456], numThreads[1]
  at io.druid.guice.DruidProcessingModule.getIntermediateResultsPool(DruidProcessingModule.java:76)curl -X 'POST' -H 'Content-Type:application/json' -d @examples/indexing/wikipedia_index_task.json 107.170.226.65:8082/druid/indexer/v1/task
{"task":"index_wikipedia_2014-03-06T05:57:19.192Z"}
  at io.druid.guice.DruidProcessingModule.getIntermediateResultsPool(DruidProcessingModule.java:76)
  while locating io.druid.collections.StupidPool<java.nio.ByteBuffer> annotated with @io.druid.guice.annotations.Global()
    for parameter 1 at io.druid.query.groupby.GroupByQueryEngine.<init>(GroupByQueryEngine.java:76)
  at io.druid.guice.QueryRunnerFactoryModule.configure(QueryRunnerFactoryModule.java:71)
  while locating io.druid.query.groupby.GroupByQueryEngine
    for parameter 0 at io.druid.query.groupby.GroupByQueryRunnerFactory.<init>(GroupByQueryRunnerFactory.java:61)
  at io.druid.guice.QueryRunnerFactoryModule.configure(QueryRunnerFactoryModule.java:68)
  while locating io.druid.query.groupby.GroupByQueryRunnerFactory
  while locating io.druid.query.QueryRunnerFactory annotated with @com.google.inject.multibindings.Element(setName=,uniqueId=22, type=MAPBINDER)
  at io.druid.guice.DruidBinders.queryRunnerFactoryBinder(DruidBinders.java:38)
  while locating java.util.Map<java.lang.Class<? extends io.druid.query.Query>, io.druid.query.QueryRunnerFactory>
    for parameter 0 at io.druid.query.DefaultQueryRunnerFactoryConglomerate.<init>(DefaultQueryRunnerFactoryConglomerate.java:36)
  while locating io.druid.query.DefaultQueryRunnerFactoryConglomerate
  at io.druid.guice.StorageNodeModule.configure(StorageNodeModule.java:52)
  while locating io.druid.query.QueryRunnerFactoryConglomerate
    for parameter 9 at io.druid.indexing.common.TaskToolboxFactory.<init>(TaskToolboxFactory.java:78)
  at io.druid.cli.CliPeon$1.configure(CliPeon.java:124)
  while locating io.druid.indexing.common.TaskToolboxFactory
    for parameter 0 at io.druid.indexing.overlord.ThreadPoolTaskRunner.<init>(ThreadPoolTaskRunner.java:68)
  at io.druid.cli.CliPeon$1.configure(CliPeon.java:150)
  while locating io.druid.indexing.overlord.ThreadPoolTaskRunner
  while locating io.druid.query.QuerySegmentWalker
    for parameter 2 at io.druid.server.QueryResource.<init>(QueryResource.java:75)
  while locating io.druid.server.QueryResource

1 error
    at com.google.inject.internal.InjectorImpl$3.get(InjectorImpl.java:1014)
    at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1036)
    at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:134)
    at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
    at io.druid.cli.CliPeon.run(CliPeon.java:202)
    at io.druid.cli.Main.main(Main.java:91)

[Eric Tschetter]

Given your resource constraints I would probably reduce the druid.computation.buffer.size to 64 meg (so whatever 64 * 1024 * 1024 is.

--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-developm...@googlegroups.com.
To post to this group, send email to druid-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/CACF%2B8rrqm2YwjCi0UQHCqc5cQZjZZ8rTWMSJuqt71NmXKB9%2BeQ%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

[David Montgomery]

whats the differemce between druid.computation.buffer.size and druid.indexer.fork.property.druid.computation.buffer.size?

Which do I use?  the latter is from the online docs example

thanks

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/CAB8U%2Bh0frqia4%2BgNzcJgcZYd%3DJ%3Dt0BNO%3DEkNToNT72zUywhF4A%40mail.gmail.com.

[David Montgomery]

That solved the problem only to lead to another....

I still get a fail fro ,the overlord node.


FAILED SelectChann...@0.0.0.0:8082: java.net.BindException: Address already in use

in the overlord runtme.properties I have the below

druid.host=107.170.226.65
druid.port=8082
druid.service=overlord

On all nodes....all are using port 8082 and druid.host is the ip address.

2014-03-06 07:23:11,755 INFO [main] io.druid.server.initialization.PropertiesModule - Loading properties from runtime.properties
2014-03-06 07:23:11,819 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.0.1.Final
2014-03-06 07:23:12,608 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[], localRepository='/root/.m2/repository', remoteRepositories=[http://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2014-03-06 07:23:14,047 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2014-03-06 07:23:14,181 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@37ceb547]
2014-03-06 07:23:14,231 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
2014-03-06 07:23:14,283 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='overlord', host='107.170.226.65:8082', port=8082}]
2014-03-06 07:23:14,413 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@55bd6757]
2014-03-06 07:23:14,429 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.HttpClientModule$DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.HttpClientModule$DruidHttpClientConfig@23332c6d]
2014-03-06 07:23:14,532 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@3125821e]
2014-03-06 07:23:14,535 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1.dzk.do.development.singapore.rtbhui.com:2181] for [druid.zk.service.host] on [io.druid.curator.CuratorConfig#getZkHosts()]
2014-03-06 07:23:14,537 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [30000] for [druid.zk.service.sessionTimeoutMs] on [io.druid.curator.CuratorConfig#getZkSessionTimeoutMs()]
2014-03-06 07:23:14,538 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [false] for [druid.curator.compress] on [io.druid.curator.CuratorConfig#enableCompression()]
2014-03-06 07:23:14,632 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2014-03-06 07:23:14,694 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@701faaed]
2014-03-06 07:23:14,989 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@61fd451c]
2014-03-06 07:23:14,994 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.segment.loading.LocalDataSegmentPusherConfig@75192bda]
2014-03-06 07:23:15,021 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@409615d]
2014-03-06 07:23:15,022 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.liveSegmentsPath] on [io.druid.server.initialization.ZkPathsConfig#getLiveSegmentsPath()]
2014-03-06 07:23:15,023 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.base] on [io.druid.server.initialization.ZkPathsConfig#getZkBasePath()]
2014-03-06 07:23:15,023 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.announcementsPath] on [io.druid.server.initialization.ZkPathsConfig#getAnnouncementsPath()]
2014-03-06 07:23:15,024 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.loadQueuePath] on [io.druid.server.initialization.ZkPathsConfig#getLoadQueuePath()]
2014-03-06 07:23:15,024 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.propertiesPath] on [io.druid.server.initialization.ZkPathsConfig#getPropertiesPath()]
2014-03-06 07:23:15,024 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.tasksPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerTaskPath()]
2014-03-06 07:23:15,025 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.statusPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerStatusPath()]
2014-03-06 07:23:15,025 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.servedSegmentsPath] on [io.druid.server.initialization.ZkPathsConfig#getServedSegmentsPath()]
2014-03-06 07:23:15,025 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.leaderLatchPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerLeaderLatchPath()]
2014-03-06 07:23:15,025 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.coordinatorPath] on [io.druid.server.initialization.ZkPathsConfig#getCoordinatorPath()]
2014-03-06 07:23:15,026 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.announcementsPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerAnnouncementPath()]
2014-03-06 07:23:15,092 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@3b313024]
2014-03-06 07:23:15,099 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.LegacyDataSegmentAnnouncerProvider@d9f9598]
2014-03-06 07:23:15,106 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.ServerInventoryViewProvider] from props[druid.announcer.] as [io.druid.client.SingleServerInventoryProvider@7c81475b]
2014-03-06 07:23:15,115 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.QueryConfig] from props[druid.query.] as [io.druid.query.QueryConfig@f4dd5a0]
2014-03-06 07:23:15,131 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@4f96fdc]
2014-03-06 07:23:15,143 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@be0b841]
2014-03-06 07:23:15,143 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [67108864] for [druid.computation.buffer.size] on [io.druid.server.DruidProcessingConfig#intermediateComputeSizeBytes()]
2014-03-06 07:23:15,143 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
2014-03-06 07:23:15,145 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [1] for [${base_path}.numThreads] on [com.metamx.common.concurrent.ExecutorServiceConfig#getNumThreads()]
2014-03-06 07:23:15,157 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@2f79da7d]
2014-03-06 07:23:15,165 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@3bdbd9ea]
2014-03-06 07:23:15,174 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [io.druid.server.initialization.ServerConfig@49f95cf6]
2014-03-06 07:23:15,271 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.core.LoggingEmitter.start()] on object[com.metamx.emitter.core.LoggingEmitter@2db4938].
2014-03-06 07:23:15,272 INFO [main] com.metamx.emitter.core.LoggingEmitter - Start: started [true]
2014-03-06 07:23:15,273 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@1a4340c0].
2014-03-06 07:23:15,273 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@35500ab8].
2014-03-06 07:23:15,280 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.HttpClient.start()] on object[com.metamx.http.client.HttpClient@63323bb].
2014-03-06 07:23:15,281 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2014-03-06 07:23:15,288 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2014-03-06 07:23:15,302 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
2014-03-06 07:23:15,302 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=127.0.0.1
2014-03-06 07:23:15,302 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_51
2014-03-06 07:23:15,302 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2014-03-06 07:23:15,302 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-7-openjdk-amd64/jre
2014-03-06 07:23:15,302 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=overlord/:/home/ubuntu/druid-services-0.6.52/lib/server-metrics-0.0.5.jar:/home/ubuntu/druid-services-0.6.52/lib/commons-io-2.0.1.jar:/home/ubuntu/druid-services-0.6.52/lib/hibernate-validator-5.0.1.Final.jar:/home/ubuntu/druid-services-0.6.52/lib/lz4-1.1.2.jar:/home/ubuntu/druid-services-0.6.52/lib/commons-lang-2.6.jar:/home/ubuntu/druid-services-0.6.52/lib/asm-3.1.jar:/home/ubuntu/druid-services-0.6.52/lib/maven-model-builder-3.1.1.jar:/home/ubuntu/druid-services-0.6.52/lib/jdbi-2.32.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-jaxrs-base-2.2.2.jar:/home/ubuntu/druid-services-0.6.52/lib/aopalliance-1.0.jar:/home/ubuntu/druid-services-0.6.52/lib/jersey-servlet-1.17.1.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-datatype-guava-2.2.2.jar:/home/ubuntu/druid-services-0.6.52/lib/tesla-aether-0.0.5.jar:/home/ubuntu/druid-services-0.6.52/lib/aether-spi-0.9.0.M2.jar:/home/ubuntu/druid-services-0.6.52/lib/curator-recipes-2.3.0.jar:/home/ubuntu/druid-services-0.6.52/lib/maven-repository-metadata-3.1.1.jar:/home/ubuntu/druid-services-0.6.52/lib/sigar-1.6.5.132.jar:/home/ubuntu/druid-services-0.6.52/lib/druid-common-0.6.52.jar:/home/ubuntu/druid-services-0.6.52/lib/java-util-0.25.2.jar:/home/ubuntu/druid-services-0.6.52/lib/extendedset-1.3.4.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-module-jaxb-annotations-2.2.2.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-core-2.2.2.jar:/home/ubuntu/druid-services-0.6.52/lib/javax.inject-1.jar:/home/ubuntu/druid-services-0.6.52/lib/classmate-0.8.0.jar:/home/ubuntu/druid-services-0.6.52/lib/curator-x-discovery-2.3.0.jar:/home/ubuntu/druid-services-0.6.52/lib/spymemcached-2.8.4.jar:/home/ubuntu/druid-services-0.6.52/lib/wagon-provider-api-2.4.jar:/home/ubuntu/druid-services-0.6.52/lib/curator-client-2.3.0.jar:/home/ubuntu/druid-services-0.6.52/lib/log4j-1.2.16.jar:/home/ubuntu/druid-services-0.6.52/lib/jetty-http-8.1.11.v20130520.jar:/home/ubuntu/druid-services-0.6.52/lib/druid-processing-0.6.52.jar:/home/ubuntu/druid-services-0.6.52/lib/irc-api-1.0-0011.jar:/home/ubuntu/druid-services-0.6.52/lib/httpclient-4.2.jar:/home/ubuntu/druid-services-0.6.52/lib/jetty-servlets-8.1.11.v20130520.jar:/home/ubuntu/druid-services-0.6.52/lib/commons-codec-1.7.jar:/home/ubuntu/druid-services-0.6.52/lib/commons-cli-1.2.jar:/home/ubuntu/druid-services-0.6.52/lib/jets3t-0.9.0.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-dataformat-smile-2.2.2.jar:/home/ubuntu/druid-services-0.6.52/lib/plexus-utils-3.0.15.jar:/home/ubuntu/druid-services-0.6.52/lib/guava-14.0.1.jar:/home/ubuntu/druid-services-0.6.52/lib/protobuf-java-2.4.0a.jar:/home/ubuntu/druid-services-0.6.52/lib/aether-connector-file-0.9.0.M2.jar:/home/ubuntu/druid-services-0.6.52/lib/joda-time-2.1.jar:/home/ubuntu/druid-services-0.6.52/lib/aether-connector-okhttp-0.0.9.jar:/home/ubuntu/druid-services-0.6.52/lib/druid-indexing-service-0.6.52.jar:/home/ubuntu/druid-services-0.6.52/lib/maxminddb-0.2.0.jar:/home/ubuntu/druid-services-0.6.52/lib/druid-server-0.6.52.jar:/home/ubuntu/druid-services-0.6.52/lib/aether-api-0.9.0.M2.jar:/home/ubuntu/druid-services-0.6.52/lib/slf4j-api-1.6.4.jar:/home/ubuntu/druid-services-0.6.52/lib/compress-lzf-0.8.4.jar:/home/ubuntu/druid-services-0.6.52/lib/org.abego.treelayout.core-1.0.1.jar:/home/ubuntu/druid-services-0.6.52/lib/aws-java-sdk-1.6.0.1.jar:/home/ubuntu/druid-services-0.6.52/lib/jetty-security-8.1.11.v20130520.jar:/home/ubuntu/druid-services-0.6.52/lib/antlr4-runtime-4.0.jar:/home/ubuntu/druid-services-0.6.52/lib/google-http-client-jackson2-1.15.0-rc.jar:/home/ubuntu/druid-services-0.6.52/lib/plexus-interpolation-1.19.jar:/home/ubuntu/druid-services-0.6.52/lib/http-client-0.8.5.jar:/home/ubuntu/druid-services-0.6.52/lib/guice-multibindings-4.0-beta.jar:/home/ubuntu/druid-services-0.6.52/lib/guice-4.0-beta.jar:/home/ubuntu/druid-services-0.6.52/lib/aether-util-0.9.0.M2.jar:/home/ubuntu/druid-services-0.6.52/lib/javax.servlet-3.0.0.v201112011016.jar:/home/ubuntu/druid-services-0.6.52/lib/commons-pool-1.6.jar:/home/ubuntu/druid-services-0.6.52/lib/druid-indexing-hadoop-0.6.52.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-jaxrs-json-provider-2.2.2.jar:/home/ubuntu/druid-services-0.6.52/lib/validation-api-1.1.0.Final.jar:/home/ubuntu/druid-services-0.6.52/lib/jersey-server-1.17.1.jar:/home/ubuntu/druid-services-0.6.52/lib/jetty-continuation-8.1.11.v20130520.jar:/home/ubuntu/druid-services-0.6.52/lib/okhttp-1.0.2.jar:/home/ubuntu/druid-services-0.6.52/lib/jline-0.9.94.jar:/home/ubuntu/druid-services-0.6.52/lib/jetty-server-8.1.11.v20130520.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-datatype-joda-2.2.2.jar:/home/ubuntu/druid-services-0.6.52/lib/druid-api-0.1.7.jar:/home/ubuntu/druid-services-0.6.52/lib/maven-aether-provider-3.1.1.jar:/home/ubuntu/druid-services-0.6.52/lib/httpcore-4.2.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-mapper-asl-1.9.11.jar:/home/ubuntu/druid-services-0.6.52/lib/curator-framework-2.3.0.jar:/home/ubuntu/druid-services-0.6.52/lib/maven-settings-3.1.1.jar:/home/ubuntu/druid-services-0.6.52/lib/java-xmlbuilder-0.4.jar:/home/ubuntu/druid-services-0.6.52/lib/rhino-1.7R4.jar:/home/ubuntu/druid-services-0.6.52/lib/emitter-0.2.9.jar:/home/ubuntu/druid-services-0.6.52/lib/maven-model-3.1.1.jar:/home/ubuntu/druid-services-0.6.52/lib/slf4j-log4j12-1.6.2.jar:/home/ubuntu/druid-services-0.6.52/lib/config-magic-0.9.jar:/home/ubuntu/druid-services-0.6.52/lib/maven-settings-builder-3.1.1.jar:/home/ubuntu/druid-services-0.6.52/lib/guice-servlet-4.0-beta.jar:/home/ubuntu/druid-services-0.6.52/lib/bytebuffer-collections-0.0.2.jar:/home/ubuntu/druid-services-0.6.52/lib/jersey-guice-1.17.1.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-databind-2.2.2.jar:/home/ubuntu/druid-services-0.6.52/lib/airline-0.6.jar:/home/ubuntu/druid-services-0.6.52/lib/geoip2-0.4.0.jar:/home/ubuntu/druid-services-0.6.52/lib/jetty-util-8.1.11.v20130520.jar:/home/ubuntu/druid-services-0.6.52/lib/zookeeper-3.4.5.jar:/home/ubuntu/druid-services-0.6.52/lib/icu4j-4.8.1.jar:/home/ubuntu/druid-services-0.6.52/lib/jetty-io-8.1.11.v20130520.jar:/home/ubuntu/druid-services-0.6.52/lib/jetty-servlet-8.1.11.v20130520.jar:/home/ubuntu/druid-services-0.6.52/lib/jboss-logging-3.1.1.GA.jar:/home/ubuntu/druid-services-0.6.52/lib/jsr305-2.0.1.jar:/home/ubuntu/druid-services-0.6.52/lib/jersey-core-1.17.1.jar:/home/ubuntu/druid-services-0.6.52/lib/aether-impl-0.9.0.M2.jar:/home/ubuntu/druid-services-0.6.52/lib/xpp3-1.1.4c.jar:/home/ubuntu/druid-services-0.6.52/lib/druid-services-0.6.52.jar:/home/ubuntu/druid-services-0.6.52/lib/commons-dbcp-1.4.jar:/home/ubuntu/druid-services-0.6.52/lib/opencsv-2.3.jar:/home/ubuntu/druid-services-0.6.52/lib/jetty-client-8.1.11.v20130520.jar:/home/ubuntu/druid-services-0.6.52/lib/netty-3.2.4.Final.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-annotations-2.2.2.jar:/home/ubuntu/druid-services-0.6.52/lib/jackson-core-asl-1.9.11.jar:/home/ubuntu/druid-services-0.6.52/lib/google-http-client-1.15.0-rc.jar:/home/ubuntu/druid-services-0.6.52/lib/mysql-connector-java-5.1.18.jar:/home/ubuntu/druid-services-0.6.52/lib/commons-logging-1.1.1.jar:/home/ubuntu/druid-services-0.6.52/config/overlord
2014-03-06 07:23:15,303 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2014-03-06 07:23:15,303 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
2014-03-06 07:23:15,303 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2014-03-06 07:23:15,303 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2014-03-06 07:23:15,303 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2014-03-06 07:23:15,303 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.5.0-17-generic
2014-03-06 07:23:15,303 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
2014-03-06 07:23:15,303 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
2014-03-06 07:23:15,303 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/home/ubuntu/druid-services-0.6.52/config/overlord
2014-03-06 07:23:15,304 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=1.dzk.do.development.singapore.rtbhui.com:2181 sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@4099dde9
2014-03-06 07:23:15,342 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@73fc0873].
2014-03-06 07:23:15,350 INFO [main-SendThread(128.199.238.103:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server 128.199.238.103/128.199.238.103:2181. Will not attempt to authenticate using SASL (unknown error)
2014-03-06 07:23:15,554 INFO [main-SendThread(128.199.238.103:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to 128.199.238.103/128.199.238.103:2181, initiating session
2014-03-06 07:23:15,761 INFO [main-SendThread(128.199.238.103:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server 128.199.238.103/128.199.238.103:2181, sessionid = 0x1448768c30e0041, negotiated timeout = 30000
2014-03-06 07:23:15,766 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2014-03-06 07:23:17,877 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@8423321].
2014-03-06 07:23:17,879 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.client.ServerInventoryView.start() throws java.lang.Exception] on object[io.druid.client.SingleServerInventoryView@21508dc2].
2014-03-06 07:23:17,883 INFO [main] org.eclipse.jetty.server.Server - jetty-8.1.11.v20130520
Mar 06, 2014 7:23:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
Mar 06, 2014 7:23:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering io.druid.server.StatusResource as a root resource class
Mar 06, 2014 7:23:18 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.17.1 02/28/2013 12:47 PM'
Mar 06, 2014 7:23:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
2014-03-06 07:23:18,817 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Created new InventoryCacheListener for /druid/servedSegments/107.170.236.216:8082
2014-03-06 07:23:18,824 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Starting inventory cache for 107.170.236.216:8082, inventoryPath /druid/servedSegments/107.170.236.216:8082
2014-03-06 07:23:18,825 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - New Server[DruidServerMetadata{name='107.170.236.216:8082', host='107.170.236.216:8082', maxSize=10000000000, tier='_default_tier', type='historical'}]
Mar 06, 2014 7:23:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
Mar 06, 2014 7:23:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.indexing.worker.executor.ChatHandlerResource to GuiceInstantiatedComponentProvider
Mar 06, 2014 7:23:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
2014-03-06 07:23:19,525 WARN [main] org.eclipse.jetty.util.component.AbstractLifeCycle - FAILED SelectChann...@0.0.0.0:8082: java.net.BindException: Address already in use
java.net.BindException: Address already in use
    at sun.nio.ch.Net.bind0(Native Method)
    at sun.nio.ch.Net.bind(Net.java:444)
    at sun.nio.ch.Net.bind(Net.java:436)
    at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
    at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
    at org.eclipse.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:187)
    at org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:316)
    at org.eclipse.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:265)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
    at org.eclipse.jetty.server.Server.doStart(Server.java:293)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
    at io.druid.server.initialization.JettyServerModule$1.start(JettyServerModule.java:124)
    at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
    at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)

    at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
    at io.druid.cli.CliPeon.run(CliPeon.java:202)
    at io.druid.cli.Main.main(Main.java:91)

2014-03-06 07:23:19,530 WARN [main] org.eclipse.jetty.util.component.AbstractLifeCycle - FAILED org.eclipse.jetty.server.Server@1160c101: java.net.BindException: Address already in use
java.net.BindException: Address already in use
    at sun.nio.ch.Net.bind0(Native Method)
    at sun.nio.ch.Net.bind(Net.java:444)
    at sun.nio.ch.Net.bind(Net.java:436)
    at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
    at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
    at org.eclipse.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:187)
    at org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:316)
    at org.eclipse.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:265)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
    at org.eclipse.jetty.server.Server.doStart(Server.java:293)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
    at io.druid.server.initialization.JettyServerModule$1.start(JettyServerModule.java:124)
    at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
    at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)

    at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
    at io.druid.cli.CliPeon.run(CliPeon.java:202)
    at io.druid.cli.Main.main(Main.java:91)

2014-03-06 07:23:19,536 ERROR [main] io.druid.cli.CliPeon - Error when starting up.  Failing.
java.net.BindException: Address already in use
    at sun.nio.ch.Net.bind0(Native Method)
    at sun.nio.ch.Net.bind(Net.java:444)
    at sun.nio.ch.Net.bind(Net.java:436)
    at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
    at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
    at org.eclipse.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:187)
    at org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:316)
    at org.eclipse.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:265)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
    at org.eclipse.jetty.server.Server.doStart(Server.java:293)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
    at io.druid.server.initialization.JettyServerModule$1.start(JettyServerModule.java:124)
    at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
    at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)

    at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
    at io.druid.cli.CliPeon.run(CliPeon.java:202)
    at io.druid.cli.Main.main(Main.java:91)

[Fangjin Yang]

Hi David, you have another java process running on the same port.

To unsubscribe from this group and stop receiving emails from it, send an email to druid-development+unsubscribe@googlegroups.com.
To post to this group, send email to druid-development@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/CACF%2B8rrqm2YwjCi0UQHCqc5cQZjZZ8rTWMSJuqt71NmXKB9%2BeQ%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

[David Montgomery]

This was the problem  druid.indexer.runner.startPort=8082.  Changed to 8088

Now I get the below. I still cant resolve the realtime node.  I only ingest realtime.  Not batch.

Please have some contact me regarding consulting to get realtime node working.  I cant launch till resolved.  5x works but prefer forward progress.

###############

#realtime log

###############
java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)

    at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
    at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
    at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)

    at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
    at io.druid.cli.Main.main(Main.java:91)
Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    at io.druid.firehose.kafka.KafkaSevenFirehoseFactory.connect(KafkaSevenFirehoseFactory.java:89)
    at io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
    at io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
    at io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
    ... 10 more

'''Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    ... 25 more





###############
#overlord log
###############
ect[io.druid.client.SingleServerInventoryView@3210b113].
2014-03-07 12:10:28,291 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.segment.realtime.RealtimeManager.start() throws java.io.IOException] on object[io.druid.segment.realtime.RealtimeManager@7be07643].
2014-03-07 12:10:28,294 INFO [main] io.druid.segment.realtime.RealtimeManager - Calling the FireDepartment and getting a Firehose.
2014-03-07 12:10:28,296 ERROR [main] io.druid.cli.CliBroker - Error when starting up.  Failing.
java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)

    at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
    at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
    at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)

    at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
    at io.druid.cli.Main.main(Main.java:91)
Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    at io.druid.firehose.kafka.KafkaSevenFirehoseFactory.connect(KafkaSevenFirehoseFactory.java:89)
    at io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
    at io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
    at io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
    ... 10 more
Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    ... 25 more

2014-03-07 12:03:21,176 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@7c985612].
2014-03-07 12:03:21,176 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='107.170.226.65:8088', host='107.170.226.65:8088', maxSize=0, tier='_default_tier', type='indexer-executor'}] at [/druid/announcements/107.170.226.65:8088]
2014-03-07 12:03:21,177 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start()] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@7258adc3].
2014-03-07 12:03:21,394 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
  "type" : "index",
  "id" : "index_wikipedia_2014-03-07T12:03:12.015Z",
  "dataSource" : "wikipedia",
  "granularitySpec" : {
    "type" : "uniform",
    "gran" : "DAY",
    "intervals" : [ "2013-08-31T00:00:00.000Z/2013-09-01T00:00:00.000Z" ]
  },
  "spatialDimensions" : [ ],
  "aggregators" : [ {
    "type" : "count",
    "name" : "count"
  }, {
    "type" : "doubleSum",
    "name" : "added",
    "fieldName" : "added"
  }, {
    "type" : "doubleSum",
    "name" : "deleted",
    "fieldName" : "deleted"
  }, {
    "type" : "doubleSum",
    "name" : "delta",
    "fieldName" : "delta"
  } ],
  "indexGranularity" : {
    "type" : "none"
  },
  "targetPartitionSize" : 0,
  "firehose" : {
    "type" : "local",
    "baseDir" : "/examples/indexing",
    "filter" : "wikipedia_data.json",
    "parser" : {
      "type" : "string",
      "timestampSpec" : {
        "column" : "timestamp",
        "format" : "auto"
      },
      "data" : {
        "format" : "json",
        "dimensions" : [ "page", "language", "user", "unpatrolled", "newPage", "robot", "anonymous", "namespace", "continent", "country", "region", "city" ],
        "spatialDimensions" : [ ]
      },
      "dimensionExclusions" : [ "timestamp" ]
    }
  },
  "rowFlushBoundary" : 0,
  "groupId" : "index_wikipedia_2014-03-07T12:03:12.015Z",
  "interval" : "2013-08-31T00:00:00.000Z/2013-09-01T00:00:00.000Z",
  "resource" : {
    "availabilityGroup" : "index_wikipedia_2014-03-07T12:03:12.015Z",
    "requiredCapacity" : 1
  }
}
2014-03-07 12:03:21,405 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_wikipedia_2014-03-07T12:03:12.015Z]: LockTryAcquireAction{interval=2013-08-31T00:00:00.000Z/2013-09-01T00:00:00.000Z}
2014-03-07 12:03:21,428 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_wikipedia_2014-03-07T12:03:12.015Z] to overlord[http://107.170.226.65:8082/druid/indexer/v1/action]: LockTryAcquireAction{interval=2013-08-31T00:00:00.000Z/2013-09-01T00:00:00.000Z}
2014-03-07 12:03:21,443 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://107.170.226.65:8082
2014-03-07 12:03:21,536 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://107.170.226.65:8082
2014-03-07 12:03:21,550 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://107.170.226.65:8082
2014-03-07 12:03:21,550 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://107.170.226.65:8082
2014-03-07 12:03:21,551 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://107.170.226.65:8082
2014-03-07 12:03:21,764 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_wikipedia_2014-03-07T12:03:12.015Z
2014-03-07 12:03:21,768 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_wikipedia_2014-03-07T12:03:12.015Z]: LockListAction{}
2014-03-07 12:03:21,770 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_wikipedia_2014-03-07T12:03:12.015Z] to overlord[http://107.170.226.65:8082/druid/indexer/v1/action]: LockListAction{}
2014-03-07 12:03:21,772 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Created new InventoryCacheListener for /druid/servedSegments/107.170.226.65:8088
2014-03-07 12:03:21,773 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Starting inventory cache for 107.170.226.65:8088, inventoryPath /druid/servedSegments/107.170.226.65:8088
2014-03-07 12:03:21,773 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - New Server[DruidServerMetadata{name='107.170.226.65:8088', host='107.170.226.65:8088', maxSize=0, tier='_default_tier', type='indexer-executor'}]
2014-03-07 12:03:21,836 ERROR [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[IndexTask{id=index_wikipedia_2014-03-07T12:03:12.015Z, type=index, dataSource=wikipedia}]
com.metamx.common.ISE: Found no files to ingest! Check your schema.
    at io.druid.segment.realtime.firehose.LocalFirehoseFactory.connect(LocalFirehoseFactory.java:94)
    at io.druid.indexing.common.task.IndexTask.getDataIntervals(IndexTask.java:175)
    at io.druid.indexing.common.task.IndexTask.run(IndexTask.java:140)
    at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:216)
    at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:195)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:744)
2014-03-07 12:03:21,851 INFO [task-runner-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
  "id" : "index_wikipedia_2014-03-07T12:03:12.015Z",
  "status" : "FAILED",
  "duration" : 80
}
2014-03-07 12:03:21,857 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@7c985612].
2014-03-07 12:03:21,857 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig$$EnhancerByCGLIB$$177c201d@4bab24eb]
2014-03-07 12:03:21,857 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/107.170.226.65:8088]
2014-03-07 12:03:22,060 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.SingleDataSegmentAnnouncer@abffd00].
2014-03-07 12:03:22,060 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.SingleDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig$$EnhancerByCGLIB$$177c201d@4bab24eb]
2014-03-07 12:03:22,061 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/107.170.226.65:8088]
2014-03-07 12:03:22,061 ERROR [main] io.druid.curator.announcement.Announcer - Path[/druid/announcements/107.170.226.65:8088] not announced, cannot unannounce.
2014-03-07 12:03:22,062 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop()] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@7258adc3].
2014-03-07 12:03:22,083 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - stopped o.e.j.s.ServletContextHandler{/,null}
2014-03-07 12:03:22,087 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - stopped o.e.j.s.ServletContextHandler{/,file:/}
2014-03-07 12:03:22,151 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@5b1c9eb1].
2014-03-07 12:03:22,152 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.client.ServerInventoryView.stop() throws java.io.IOException] on object[io.druid.client.SingleServerInventoryView@512e18d7].
2014-03-07 12:03:22,153 ERROR [ServerInventoryView-0] org.apache.curator.framework.recipes.cache.PathChildrenCache -
java.lang.InterruptedException
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:503)
    at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1309)
    at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1036)
    at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1069)
    at org.apache.curator.utils.ZKPaths.mkdirs(ZKPaths.java:163)
    at org.apache.curator.utils.EnsurePath$InitialHelper$1.call(EnsurePath.java:137)
    at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
    at org.apache.curator.utils.EnsurePath$InitialHelper.ensure(EnsurePath.java:129)
    at org.apache.curator.utils.EnsurePath.ensure(EnsurePath.java:90)
    at org.apache.curator.framework.recipes.cache.PathChildrenCache.refresh(PathChildrenCache.java:469)
    at org.apache.curator.framework.recipes.cache.RefreshOperation.invoke(RefreshOperation.java:35)
    at org.apache.curator.framework.recipes.cache.PathChildrenCache$11.run(PathChildrenCache.java:755)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:744)
2014-03-07 12:03:22,159 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@6fa61bae].
2014-03-07 12:03:22,160 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@6d13c68d].
2014-03-07 12:03:22,168 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
2014-03-07 12:03:22,369 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x1448768c30e004a closed
2014-03-07 12:03:22,370 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.HttpClient.stop()] on object[com.metamx.http.client.HttpClient@45e3cb25].
2014-03-07 12:03:22,371 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down
2014-03-07 12:03:22,383 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@f1bce81].
2014-03-07 12:03:22,383 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@5515dfdb].
2014-03-07 12:03:22,383 INFO [main] com.metamx.emitter.core.LoggingEmitter - Close: started [false]
2014-03-07 12:03:22,384 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.core.LoggingEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.core.LoggingEmitter@9abd962].

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/423ddddb-f096-437e-8066-cf4c07543363%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Manh Tran]

Hi David,

I also have the same problem with you. How to you fix issue "Not enough direct memory".

Many thanks,

MT

[Hagen Rother]

You need to pass these parameters to the jvm when you start it.

See https://github.com/zenops/cookbooks/blob/master/cookbooks/druid/templates/default/druid-runner.sh#L12 for reference.

--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-developm...@googlegroups.com.
To post to this group, send email to druid-de...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/4a2d7fcd-420e-4118-8aa1-4effc2b2fa43%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Hagen Rother
Senior Software Architect | LiquidM
LiquidM Technology GmbH Paul-Lincke-Ufer 39-40 | 10999 Berlin | Germany
twitter |  facebook |  LinkedIn
Phone:	+49 176 15 00 38 77
Internet:	www.liquidm.com
LiquidM is hiring, check: LiquidM Career Center

[Fangjin Yang]

Hi Manh, for what its worth, the exception will tell you what to set JVM max direct memory to depending on the size of your computation buffer and the number of processing threads you have.

[tao...@yahoo-inc.com]

I met the similar issue, you can set the parameters in configuration file.

druid.indexer.runner.javaOpts=-server -Xmx1g -Xms1g -XX:NewSize=256m -XX:MaxNewSize=256m -XX:MaxDirectMemorySize=536870912  -XX:+PrintGCDetails -XX:+PrintGCTimeStamp

Thanks,

Tao

[tao...@yahoo-inc.com]

Hi, Fangjin:

Could you help me to have a look at this issue, It blocked me for a long time, I'm confused about it.

https://groups.google.com/forum/#!topic/druid-development/LFXkjON35ng

Thanks,

Tao

[Fangjin Yang]

Hi Tao, I responded to you in the other thread. Sorry for the delay, crazy day.