Historical node can't read from hdfs deep storage

464 views

Skip to first unread message

tec...@splicky.com

unread,

Jun 26, 2015, 6:13:06 AM6/26/15

to druid...@googlegroups.com

Being pretty new to hadoop and hdfs I finally managed to submit the wikipedia example task to the indexing service and get it stored in hdfs. Segment is in database and appears on hdfs cluster in the filesystem.

Now my historical node is causing problems, because it can't read the hdfs segment:

2015-06-26T10:03:45,508 ERROR [ZkCoordinator-0] io.druid.server.coordination.ZkCoordinator - Failed to load segment for dataSource: {class=io.druid.server.coordination.ZkCoordinator, exceptionType=class io.druid.segment.loading.SegmentLoadingException, exceptionMessage=Exception loading segment[wikipedia_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2015-06-26T10:03:11.370Z], segment=DataSegment{size=9850, shardSpec=NoneShardSpec, metrics=[count, added, deleted, delta], dimensions=[anonymous, city, continent, country, language, namespace, newPage, page, region, robot, unpatrolled, user], version='2015-06-26T10:03:11.370Z', loadSpec={type=hdfs, path=hdfs://XXXXX:8020/user/YYYY/data/wikipedia/20130831T000000.000Z_20130901T000000.000Z/2015-06-26T10_03_11.370Z/0/index.zip}, interval=2013-08-31T00:00:00.000Z/2013-09-01T00:00:00.000Z, dataSource='wikipedia', binaryVersion='9'}}

io.druid.segment.loading.SegmentLoadingException: Exception loading segment[wikipedia_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2015-06-26T10:03:11.370Z]

at io.druid.server.coordination.ZkCoordinator.loadSegment(ZkCoordinator.java:138) ~[druid-server-0.7.3.jar:0.7.3]

at io.druid.server.coordination.ZkCoordinator.addSegment(ZkCoordinator.java:163) [druid-server-0.7.3.jar:0.7.3]

at io.druid.server.coordination.SegmentChangeRequestLoad.go(SegmentChangeRequestLoad.java:42) [druid-server-0.7.3.jar:0.7.3]

at io.druid.server.coordination.BaseZkCoordinator$1.childEvent(BaseZkCoordinator.java:125) [druid-server-0.7.3.jar:0.7.3]

at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:516) [curator-recipes-2.7.0.jar:?]

at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:510) [curator-recipes-2.7.0.jar:?]

at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:92) [curator-framework-2.7.0.jar:?]

at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) [guava-16.0.1.jar:?]

at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:83) [curator-framework-2.7.0.jar:?]

at org.apache.curator.framework.recipes.cache.PathChildrenCache.callListeners(PathChildrenCache.java:507) [curator-recipes-2.7.0.jar:?]

at org.apache.curator.framework.recipes.cache.EventOperation.invoke(EventOperation.java:35) [curator-recipes-2.7.0.jar:?]

at org.apache.curator.framework.recipes.cache.PathChildrenCache$9.run(PathChildrenCache.java:759) [curator-recipes-2.7.0.jar:?]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [?:1.7.0_76]

at java.util.concurrent.FutureTask.run(FutureTask.java:262) [?:1.7.0_76]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [?:1.7.0_76]

at java.util.concurrent.FutureTask.run(FutureTask.java:262) [?:1.7.0_76]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_76]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_76]

at java.lang.Thread.run(Thread.java:745) [?:1.7.0_76]

Caused by: java.lang.IllegalArgumentException: Could not resolve type id 'hdfs' into a subtype of [simple type, class io.druid.segment.loading.LoadSpec]

at [Source: N/A; line: -1, column: -1]

at com.fasterxml.jackson.databind.ObjectMapper._convert(ObjectMapper.java:2774) ~[jackson-databind-2.4.4.jar:2.4.4]

at com.fasterxml.jackson.databind.ObjectMapper.convertValue(ObjectMapper.java:2700) ~[jackson-databind-2.4.4.jar:2.4.4]

at io.druid.segment.loading.SegmentLoaderLocalCacheManager.getSegmentFiles(SegmentLoaderLocalCacheManager.java:140) ~[druid-server-0.7.3.jar:0.7.3]

at io.druid.segment.loading.SegmentLoaderLocalCacheManager.getSegment(SegmentLoaderLocalCacheManager.java:93) ~[druid-server-0.7.3.jar:0.7.3]

at io.druid.server.coordination.ServerManager.loadSegment(ServerManager.java:150) ~[druid-server-0.7.3.jar:0.7.3]

at io.druid.server.coordination.ZkCoordinator.loadSegment(ZkCoordinator.java:134) ~[druid-server-0.7.3.jar:0.7.3]

... 18 more

Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not resolve type id 'hdfs' into a subtype of [simple type, class io.druid.segment.loading.LoadSpec]

at [Source: N/A; line: -1, column: -1]

at com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148) ~[jackson-databind-2.4.4.jar:2.4.4]

at com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:862) ~[jackson-databind-2.4.4.jar:2.4.4]

at com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:167) ~[jackson-databind-2.4.4.jar:2.4.4]

at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:99) ~[jackson-databind-2.4.4.jar:2.4.4]

at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84) ~[jackson-databind-2.4.4.jar:2.4.4]

at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132) ~[jackson-databind-2.4.4.jar:2.4.4]

at com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41) ~[jackson-databind-2.4.4.jar:2.4.4]

at com.fasterxml.jackson.databind.ObjectMapper._convert(ObjectMapper.java:2769) ~[jackson-databind-2.4.4.jar:2.4.4]

at com.fasterxml.jackson.databind.ObjectMapper.convertValue(ObjectMapper.java:2700) ~[jackson-databind-2.4.4.jar:2.4.4]

at io.druid.segment.loading.SegmentLoaderLocalCacheManager.getSegmentFiles(SegmentLoaderLocalCacheManager.java:140) ~[druid-server-0.7.3.jar:0.7.3]

at io.druid.segment.loading.SegmentLoaderLocalCacheManager.getSegment(SegmentLoaderLocalCacheManager.java:93) ~[druid-server-0.7.3.jar:0.7.3]

at io.druid.server.coordination.ServerManager.loadSegment(ServerManager.java:150) ~[druid-server-0.7.3.jar:0.7.3]

at io.druid.server.coordination.ZkCoordinator.loadSegment(ZkCoordinator.java:134) ~[druid-server-0.7.3.jar:0.7.3]

... 18 more

2015-06-26T10:03:45,513 INFO [ZkCoordinator-0] io.druid.server.coordination.ZkCoordinator - zNode[/druid/loadQueue/localhost:8083/wikipedia_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2015-06-26T10:03:11.370Z] was removed

2015-06-26T10:04:15,487 INFO [ZkCoordinator-Exec--0] io.druid.server.coordination.ServerManager - Told to delete a queryable for a dataSource[wikipedia] that doesn't exist.

So the basic problem seems to be:

Caused by: java.lang.IllegalArgumentException: Could not resolve type id 'hdfs' into a subtype of [simple type, class io.druid.segment.loading.LoadSpec]

How do I solve this. I started the historical node with:

java -Xmx256m -Duser.timezone=UTC -Dfile.encoding=UTF-8 -classpath config/_common:config/historical:lib/*:`hadoop classpath` io.druid.cli.Main server historical

And in config/_common/common.runtime.properties I have:

druid.extensions.coordinates=["io.druid.extensions:druid-examples","io.druid.extensions:druid-kafka-eight","io.druid.extensions:mysql-metadata-storage","io.druid.extensions:druid-hdfs-storage:0.7.0"]

# Zookeeper

druid.zk.service.host=localhost

# Metadata Storage (mysql)

druid.metadata.storage.type=mysql

druid.metadata.storage.connector.connectURI=jdbc\:mysql\://localhost\:3306/druid

druid.metadata.storage.connector.user=druid

druid.metadata.storage.connector.password=diurd

druid.storage.type=hdfs

druid.storage.storageDirectory=hdfs://XXXXXX:8020/user/YYYYY/data

# Query Cache (we use a simple 10mb heap-based local cache on the broker)

druid.cache.type=local

druid.cache.sizeInBytes=10000000

# Indexing service discovery

druid.selectors.indexing.serviceName=overlord

# Monitoring (disabled for examples, if you enable SysMonitor, make sure to include sigar jar in your cp)

# druid.monitoring.monitors=["com.metamx.metrics.SysMonitor","com.metamx.metrics.JvmMonitor"]

# Metrics logging (disabled for examples - change this to logging or http in production)

druid.emitter=noop

Any idea what might be the reason?

Nishant Bangarwa

unread,

Jun 26, 2015, 10:38:40 AM6/26/15

to druid...@googlegroups.com

Hi,

you need to add hdfs-storage as an extension to your historical runtime.properties too so that it can download segments from deep storage.

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/a56b5d95-2065-485a-a923-e8ddef2f0d24%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Nishant

Software Engineer

METAMARKETS

m	+91-9729200044

nishant....@metamarkets.com

Fangjin Yang

unread,

Jun 27, 2015, 1:39:14 AM6/27/15

to druid...@googlegroups.com, tec...@splicky.com

Hi Roman, do you have the logs when your historical starts up? Just want to make sure the hdfs extension is being loaded.

Roman Brunnemann

unread,

Jun 29, 2015, 3:08:51 AM6/29/15

to druid...@googlegroups.com

For me it looks like it is loaded:

roman@Roman-Notebook:~/software/druid-0.7.3$ java -Xmx256m -Duser.timezone=UTC -Dfile.encoding=UTF-8 -classpath config/_common:config/historical:lib/*:/home/roman/Downloads/hadoop-2.7.0/etc/hadoop:/home/roman/Downloads/hadoop-2.7.0/lib:/home/roman/Downloads/hadoop-2.7.0/lib/native:/usr/local/hadoop/share/hadoop/common/:/usr/local/hadoop/share/hadoop/hdfs/:/home/roman/Downloads/hadoop-2.7.0/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/contrib/capacity-scheduler/*.jar io.druid.cli.Main server historical

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/home/roman/software/druid-0.7.3/lib/log4j-slf4j-impl-2.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

2015-06-29T07:07:33,645 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties

2015-06-29T07:07:33,688 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties

2015-06-29T07:07:33,805 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final

2015-06-29T07:07:35,604 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:druid-examples, io.druid.extensions:druid-kafka-eight, io.druid.extensions:mysql-metadata-storage, io.druid.extensions:druid-hdfs-storage:0.7.0], defaultVersion='0.7.3', localRepository='/home/roman/.m2/repository', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]

2015-06-29T07:07:36,008 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.cli.CliCommandCreator]

2015-06-29T07:07:37,786 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/io/druid/extensions/druid-examples/0.7.3/druid-examples-0.7.3.jar]

2015-06-29T07:07:37,787 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/twitter4j/twitter4j-core/3.0.3/twitter4j-core-3.0.3.jar]

2015-06-29T07:07:37,787 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/twitter4j/twitter4j-async/3.0.3/twitter4j-async-3.0.3.jar]

2015-06-29T07:07:37,787 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/twitter4j/twitter4j-stream/3.0.3/twitter4j-stream-3.0.3.jar]

2015-06-29T07:07:37,787 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-validator/commons-validator/1.4.0/commons-validator-1.4.0.jar]

2015-06-29T07:07:37,787 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-beanutils/commons-beanutils/1.8.3/commons-beanutils-1.8.3.jar]

2015-06-29T07:07:37,787 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]

2015-06-29T07:07:37,787 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar]

2015-06-29T07:07:37,817 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.cli.CliCommandCreator]

2015-06-29T07:07:38,018 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/io/druid/extensions/druid-kafka-eight/0.7.3/druid-kafka-eight-0.7.3.jar]

2015-06-29T07:07:38,018 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/kafka/kafka_2.10/0.8.2.1/kafka_2.10-0.8.2.1.jar]

2015-06-29T07:07:38,018 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar]

2015-06-29T07:07:38,018 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar]

2015-06-29T07:07:38,019 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/kafka/kafka-clients/0.8.2.1/kafka-clients-0.8.2.1.jar]

2015-06-29T07:07:38,019 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar]

2015-06-29T07:07:38,019 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/xerial/snappy/snappy-java/1.1.1.6/snappy-java-1.1.1.6.jar]

2015-06-29T07:07:38,019 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar]

2015-06-29T07:07:38,019 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar]

2015-06-29T07:07:38,019 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/log4j/log4j/1.2.16/log4j-1.2.16.jar]

2015-06-29T07:07:38,019 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/jline/jline/0.9.94/jline-0.9.94.jar]

2015-06-29T07:07:38,019 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar]

2015-06-29T07:07:38,019 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar]

2015-06-29T07:07:38,019 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/101tec/zkclient/0.3/zkclient-0.3.jar]

2015-06-29T07:07:38,223 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:mysql-metadata-storage] for class[io.druid.cli.CliCommandCreator]

2015-06-29T07:07:38,527 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/io/druid/extensions/mysql-metadata-storage/0.7.3/mysql-metadata-storage-0.7.3.jar]

2015-06-29T07:07:38,527 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/mysql/mysql-connector-java/5.1.34/mysql-connector-java-5.1.34.jar]

2015-06-29T07:07:38,527 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/jdbi/jdbi/2.32/jdbi-2.32.jar]

2015-06-29T07:07:38,584 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage:0.7.0] for class[io.druid.cli.CliCommandCreator]

2015-06-29T07:07:39,317 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/io/druid/extensions/druid-hdfs-storage/0.7.0/druid-hdfs-storage-0.7.0.jar]

2015-06-29T07:07:39,317 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/net/java/dev/jets3t/jets3t/0.9.1/jets3t-0.9.1.jar]

2015-06-29T07:07:39,317 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-codec/commons-codec/1.7/commons-codec-1.7.jar]

2015-06-29T07:07:39,317 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.12/jackson-core-asl-1.9.12.jar]

2015-06-29T07:07:39,317 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.12/jackson-mapper-asl-1.9.12.jar]

2015-06-29T07:07:39,317 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar]

2015-06-29T07:07:39,317 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/mx4j/mx4j/3.0.2/mx4j-3.0.2.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/javax/mail/mail/1.4.7/mail-1.4.7.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/bouncycastle/bcprov-jdk15/1.46/bcprov-jdk15-1.46.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/httpcomponents/httpclient/4.2/httpclient-4.2.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/httpcomponents/httpcore/4.2/httpcore-4.2.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/hadoop/hadoop-client/2.3.0/hadoop-client-2.3.0.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/hadoop/hadoop-common/2.3.0/hadoop-common-2.3.0.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar]

2015-06-29T07:07:39,318 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/hadoop/hadoop-auth/2.3.0/hadoop-auth-2.3.0.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/google/code/findbugs/jsr305/2.0.1/jsr305-2.0.1.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar]

2015-06-29T07:07:39,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.3.0/hadoop-hdfs-2.3.0.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.3.0/hadoop-mapreduce-client-app-2.3.0.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.3.0/hadoop-yarn-client-2.3.0.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.3.0/hadoop-yarn-server-common-2.3.0.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.3.0/hadoop-yarn-api-2.3.0.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.3.0/hadoop-yarn-common-2.3.0.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar]

2015-06-29T07:07:39,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/sun/jersey/jersey-core/1.17.1/jersey-core-1.17.1.jar]

2015-06-29T07:07:39,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/org/apache/hadoop/hadoop-annotations/2.3.0/hadoop-annotations-2.3.0.jar]

2015-06-29T07:07:39,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/metamx/emitter/0.3.0/emitter-0.3.0.jar]

2015-06-29T07:07:39,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/metamx/http-client/1.0.0/http-client-1.0.0.jar]

2015-06-29T07:07:39,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/io/netty/netty/3.9.5.Final/netty-3.9.5.Final.jar]

2015-06-29T07:07:39,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/google/guava/guava/16.0.1/guava-16.0.1.jar]

2015-06-29T07:07:39,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.4.4/jackson-annotations-2.4.4.jar]

2015-06-29T07:07:39,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.4.4/jackson-core-2.4.4.jar]

2015-06-29T07:07:39,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/home/roman/.m2/repository/commons-io/commons-io/2.0.1/commons-io-2.0.1.jar]

2015-06-29T07:07:43,668 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.initialization.DruidModule]

2015-06-29T07:07:43,669 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.examples.ExamplesDruidModule] for class[io.druid.initialization.DruidModule]

2015-06-29T07:07:43,669 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.initialization.DruidModule]

2015-06-29T07:07:43,670 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.firehose.kafka.KafkaEightDruidModule] for class[io.druid.initialization.DruidModule]

2015-06-29T07:07:43,671 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:mysql-metadata-storage] for class[io.druid.initialization.DruidModule]

2015-06-29T07:07:43,672 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.metadata.storage.mysql.MySQLMetadataStorageModule] for class[io.druid.initialization.DruidModule]

2015-06-29T07:07:43,672 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage:0.7.0] for class[io.druid.initialization.DruidModule]

2015-06-29T07:07:43,673 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.storage.hdfs.HdfsStorageDruidModule] for class[io.druid.initialization.DruidModule]

2015-06-29T07:07:45,913 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@5b356c94]

2015-06-29T07:07:45,921 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]

2015-06-29T07:07:45,945 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='historical', host='localhost', port=8083}]

2015-06-29T07:07:45,971 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@b0ac4b5]

2015-06-29T07:07:45,973 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.client.cache.CacheMonitor@5cfea986]

2015-06-29T07:07:46,014 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M}]

2015-06-29T07:07:46,031 INFO [main] org.eclipse.jetty.util.log - Logging initialized @22451ms

2015-06-29T07:07:46,176 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.SegmentLoaderConfig] from props[druid.segmentCache.] as [SegmentLoaderConfig{locations=[StorageLocationConfig{path=/tmp/druid/indexCache, maxSize=10000000000}], deleteOnRemove=true, dropSegmentDelayMillis=30000, infoDir=null}]

2015-06-29T07:07:46,194 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [100000000] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]

2015-06-29T07:07:46,196 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]

2015-06-29T07:07:46,197 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]

2015-06-29T07:07:46,198 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]

2015-06-29T07:07:46,299 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@cb8c6fb]

2015-06-29T07:07:46,302 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@4c9a3337]

2015-06-29T07:07:46,306 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@18241b10]

2015-06-29T07:07:46,311 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.historical.cache.] as [io.druid.client.cache.CacheConfig@7ec0b92e]

2015-06-29T07:07:46,317 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@6101972a]

2015-06-29T07:07:46,328 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@58d3f4be]

2015-06-29T07:07:46,332 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@1949dcbd]

2015-06-29T07:07:46,336 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@1fced09a]

2015-06-29T07:07:46,340 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@29fda4c1]

2015-06-29T07:07:46,358 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29

2015-06-29T07:07:46,458 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@62427f26]

2015-06-29T07:07:46,460 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@4c1df613].

2015-06-29T07:07:46,461 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@1bb9dfae].

2015-06-29T07:07:46,472 INFO [main] org.eclipse.jetty.server.Server - jetty-9.2.5.v20141112

Jun 29, 2015 7:07:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register

INFO: Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class

Jun 29, 2015 7:07:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register

INFO: Registering io.druid.server.StatusResource as a root resource class

Jun 29, 2015 7:07:46 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate

INFO: Initiating Jersey application, version 'Jersey: 1.17.1 02/28/2013 12:47 PM'

Jun 29, 2015 7:07:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider

INFO: Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"

Jun 29, 2015 7:07:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider

INFO: Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider

Jun 29, 2015 7:07:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider

INFO: Binding io.druid.server.http.HistoricalResource to GuiceInstantiatedComponentProvider

Jun 29, 2015 7:07:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider

INFO: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"

2015-06-29T07:07:47,598 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@10013129{/,null,AVAILABLE}

2015-06-29T07:07:47,688 INFO [main] org.eclipse.jetty.server.ServerConnector - Started ServerConnector@771c674a{HTTP/1.1}{0.0.0.0:8083}

2015-06-29T07:07:47,689 INFO [main] org.eclipse.jetty.server.Server - Started @24112ms

2015-06-29T07:07:47,690 INFO [main] io.druid.curator.CuratorModule - Starting Curator

2015-06-29T07:07:47,690 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting

2015-06-29T07:07:47,722 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=localhost

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_76

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-7-oracle/jre

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=config/_common:config/historical:lib/aopalliance-1.0.jar:lib/rhino-1.7R5.jar:lib/org.abego.treelayout.core-1.0.1.jar:lib/validation-api-1.1.0.Final.jar:lib/maven-settings-builder-3.1.1.jar:lib/mx4j-3.0.2.jar:lib/mapdb-1.0.7.jar:lib/compress-lzf-1.0.3.jar:lib/jackson-databind-2.4.4.jar:lib/bytebuffer-collections-0.1.5.jar:lib/jetty-client-9.2.5.v20141112.jar:lib/aether-spi-0.9.0.M2.jar:lib/javax.el-3.0.0.jar:lib/emitter-0.3.1.jar:lib/jdbi-2.32.jar:lib/maven-aether-provider-3.1.1.jar:lib/classmate-1.0.0.jar:lib/maven-settings-3.1.1.jar:lib/xpp3-1.1.4c.jar:lib/lz4-1.3.0.jar:lib/joda-time-2.6.jar:lib/curator-client-2.7.0.jar:lib/okhttp-1.0.2.jar:lib/maven-repository-metadata-3.1.1.jar:lib/jetty-servlet-9.2.5.v20141112.jar:lib/zookeeper-3.4.6.jar:lib/log4j-1.2-api-2.2.jar:lib/httpclient-4.2.jar:lib/jetty-http-9.2.5.v20141112.jar:lib/commons-cli-1.2.jar:lib/jackson-jaxrs-smile-provider-2.4.4.jar:lib/java-xmlbuilder-0.4.jar:lib/javax.servlet-api-3.1.0.jar:lib/druid-aws-common-0.7.3.jar:lib/http-client-1.0.2.jar:lib/jetty-io-9.2.5.v20141112.jar:lib/druid-api-0.3.8.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/druid-common-0.7.3.jar:lib/jetty-util-9.2.5.v20141112.jar:lib/guice-servlet-4.0-beta.jar:lib/commons-codec-1.7.jar:lib/config-magic-0.9.jar:lib/jackson-core-2.4.4.jar:lib/slf4j-api-1.6.4.jar:lib/jetty-continuation-9.2.5.v20141112.jar:lib/jackson-datatype-joda-2.4.4.jar:lib/log4j-slf4j-impl-2.2.jar:lib/tesla-aether-0.0.5.jar:lib/jetty-servlets-9.2.5.v20141112.jar:lib/jersey-guice-1.17.1.jar:lib/java-util-0.27.0.jar:lib/derby-10.11.1.1.jar:lib/asm-3.1.jar:lib/jackson-dataformat-smile-2.4.4.jar:lib/log4j-core-2.2.jar:lib/bcprov-jdk15on-1.51.jar:lib/jsr305-2.0.1.jar:lib/aws-java-sdk-1.8.11.jar:lib/curator-recipes-2.7.0.jar:lib/commons-logging-1.1.1.jar:lib/netty-3.9.5.Final.jar:lib/jcl-over-slf4j-1.7.10.jar:lib/jackson-jaxrs-json-provider-2.4.4.jar:lib/aws-java-sdk-core-1.8.11.jar:lib/druid-indexing-hadoop-0.7.3.jar:lib/jboss-logging-3.1.3.GA.jar:lib/google-http-client-1.15.0-rc.jar:lib/opencsv-2.3.jar:lib/commons-dbcp2-2.0.1.jar:lib/derbyclient-10.11.1.1.jar:lib/jersey-server-1.17.1.jar:lib/commons-lang-2.6.jar:lib/jackson-annotations-2.4.4.jar:lib/aether-impl-0.9.0.M2.jar:lib/log4j-api-2.2.jar:lib/druid-processing-0.7.3.jar:lib/curator-x-discovery-2.7.0.jar:lib/jetty-server-9.2.5.v20141112.jar:lib/commons-pool-1.6.jar:lib/plexus-utils-3.0.15.jar:lib/protobuf-java-2.5.0.jar:lib/jline-0.9.94.jar:lib/derbynet-10.11.1.1.jar:lib/jersey-core-1.17.1.jar:lib/aether-api-0.9.0.M2.jar:lib/guice-multibindings-4.0-beta.jar:lib/google-http-client-jackson2-1.15.0-rc.jar:lib/extendedset-1.3.8.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/log4j-jul-2.2.jar:lib/aether-util-0.9.0.M2.jar:lib/curator-framework-2.7.0.jar:lib/guice-4.0-beta.jar:lib/jets3t-0.9.3.jar:lib/jetty-proxy-9.2.5.v20141112.jar:lib/jackson-module-jaxb-annotations-2.4.4.jar:lib/geoip2-0.4.0.jar:lib/antlr4-runtime-4.0.jar:lib/spymemcached-2.11.4.jar:lib/irc-api-1.0-0011.jar:lib/maxminddb-0.2.0.jar:lib/plexus-interpolation-1.19.jar:lib/airline-0.6.jar:lib/druid-server-0.7.3.jar:lib/commons-io-2.0.1.jar:lib/activation-1.1.1.jar:lib/icu4j-4.8.1.jar:lib/RoaringBitmap-0.4.5.jar:lib/guava-16.0.1.jar:lib/javax.inject-1.jar:lib/jackson-jaxrs-base-2.4.4.jar:lib/javax.el-api-3.0.0.jar:lib/maven-model-3.1.1.jar:lib/wagon-provider-api-2.4.jar:lib/druid-services-0.7.3.jar:lib/jetty-security-9.2.5.v20141112.jar:lib/jersey-servlet-1.17.1.jar:lib/disruptor-3.3.0.jar:lib/maven-model-builder-3.1.1.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/httpcore-4.2.jar:lib/commons-pool2-2.2.jar:lib/mail-1.4.7.jar:lib/server-metrics-0.1.1.jar:lib/jackson-datatype-guava-2.4.4.jar:lib/jackson-core-asl-1.9.12.jar:lib/druid-indexing-service-0.7.3.jar:/home/roman/Downloads/hadoop-2.7.0/etc/hadoop:/home/roman/Downloads/hadoop-2.7.0/lib:/home/roman/Downloads/hadoop-2.7.0/lib/native:/usr/local/hadoop/share/hadoop/common/:/usr/local/hadoop/share/hadoop/hdfs/:/home/roman/Downloads/hadoop-2.7.0/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-math3-3.1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/httpclient-4.2.5.jar:/usr/local/hadoop/share/hadoop/common/lib/jsr305-3.0.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-logging-1.1.3.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/usr/local/hadoop/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/usr/local/hadoop/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/usr/local/hadoop/share/hadoop/common/lib/zookeeper-3.4.6.jar:/usr/local/hadoop/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/usr/local/hadoop/share/hadoop/common/lib/hamcrest-core-1.3.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-auth-2.7.0.jar:/usr/local/hadoop/share/hadoop/common/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/curator-client-2.7.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/usr/local/hadoop/share/hadoop/common/lib/netty-3.6.2.Final.jar:/usr/local/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/usr/local/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/usr/local/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-lang-2.6.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/usr/local/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/common/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/common/lib/curator-framework-2.7.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jets3t-0.9.0.jar:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-io-2.4.jar:/usr/local/hadoop/share/hadoop/common/lib/junit-4.11.jar:/usr/local/hadoop/share/hadoop/common/lib/httpcore-4.2.5.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-annotations-2.7.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/usr/local/hadoop/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/share/hadoop/common/lib/gson-2.2.4.jar:/usr/local/hadoop/share/hadoop/common/lib/stax-api-1.0-2.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/usr/local/hadoop/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/usr/local/hadoop/share/hadoop/common/hadoop-common-2.7.0-tests.jar:/usr/local/hadoop/share/hadoop/common/hadoop-nfs-2.7.0.jar:/usr/local/hadoop/share/hadoop/common/hadoop-common-2.7.0.jar:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-io-2.4.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.0.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.0-tests.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-json-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jettison-1.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/usr/local/hadoop/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-client-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/yarn/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-collections-3.2.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/activation-1.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-io-2.4.jar:/usr/local/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.0-tests.jar:/contrib/capacity-scheduler/*.jar

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.13.0-46-generic

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=roman

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/home/roman

2015-06-29T07:07:47,723 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/home/roman/software/druid-0.7.3

2015-06-29T07:07:47,724 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@2ea94532

2015-06-29T07:07:48,075 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@2f3a85ba].

2015-06-29T07:07:48,076 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.BaseZkCoordinator.start() throws java.io.IOException] on object[io.druid.server.coordination.ZkCoordinator@2b218e8f].

2015-06-29T07:07:48,076 INFO [main] io.druid.server.coordination.ZkCoordinator - Starting zkCoordinator for server[localhost:8083]

2015-06-29T07:07:48,369 INFO [main-SendThread(versperrt:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server versperrt/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)

2015-06-29T07:07:48,447 INFO [main-SendThread(versperrt:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to versperrt/127.0.0.1:2181, initiating session

2015-06-29T07:07:48,502 INFO [main-SendThread(versperrt:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server versperrt/127.0.0.1:2181, sessionid = 0x14e202dba48008f, negotiated timeout = 30000

2015-06-29T07:07:48,506 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED

2015-06-29T07:07:49,822 INFO [main] io.druid.server.coordination.ZkCoordinator$BackgroundSegmentAnnouncer - Completed background segment announcing

2015-06-29T07:07:49,822 INFO [main] io.druid.server.coordination.ZkCoordinator - Cache load took 276 ms

2015-06-29T07:07:49,823 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@695398f7].

2015-06-29T07:07:49,824 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='localhost:8083', host='localhost:8083', maxSize=10000000000, tier='_default_tier', type='historical', priority='0'}] at [/druid/announcements/localhost:8083]

Roman Brunnemann

unread,

Jun 30, 2015, 11:16:52 AM6/30/15

to druid...@googlegroups.com

I get it done, it turned out that I used the wrong version:

WRONG:

druid.extensions.coordinates=["io.druid.extensions:druid-examples","io.druid.extensions:druid-kafka-eight","io.druid.extensions:mysql-metadata-storage","io.druid.extensions:druid-hdfs-storage:0.7.0"]

CORRECT:

druid.extensions.coordinates=["io.druid.extensions:druid-examples","io.druid.extensions:druid-kafka-eight","io.druid.extensions:mysql-metadata-storage","io.druid.extensions:druid-hdfs-storage:0.7.3"]

(just the last digit)

Thanks for your help

Reply all

Reply to author

Forward

0 new messages