How to add druid-google-extensions in druid-0.11.0

57 views
Skip to first unread message

MONICA SINGH

unread,
Dec 12, 2017, 12:17:51 AM12/12/17
to Druid User
I am using druid-0.11.0 version. 
In conf/druid/_common/common.runtime.properties

Set druid.extensions.loadlist=["druid-google-extensions].
Comment out the configurations for local storage under "Deep Storage" and "Indexing service logs".

and added

## Google cloud storage#druid.storage.type=googledruid.google.bucket=dvsearchdruid.google.prefix=dvsearch/logs

I have also added druid-google-extensions-0.11.0 jar in druid-0.11.0/extensions/druid-google-extensions.

When I am running the druid servers error is coming
Exception in thread "main" java.util.ServiceConfigurationError: io.druid.initialization.DruidModule: Provider io.druid.storage.google.GoogleStorageDruidModule could not be instantiated at java.util.ServiceLoader.fail(ServiceLoader.java:232) at java.util.ServiceLoader.access$100(ServiceLoader.java:185) at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:384) at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404) at java.util.ServiceLoader$1.next(ServiceLoader.java:480) at java.lang.Iterable.forEach(Iterable.java:74) at io.druid.initialization.Initialization$ServiceLoadingFromExtensions.addAllFromFileSystem(Initialization.java:179) at io.druid.initialization.Initialization$ServiceLoadingFromExtensions.<init>(Initialization.java:163) at io.druid.initialization.Initialization$ServiceLoadingFromExtensions.<init>(Initialization.java:149) at io.druid.initialization.Initialization.getFromExtensions(Initialization.java:144)

Can anyone please tell me the steps for adding druid-google-extensions in druid-0.11.0?

Erik Dubbelboer

unread,
Dec 13, 2017, 2:24:47 AM12/13/17
to Druid User
Not sure if this is the issue but in what you just pasted there is a " missing in the loadlist.
Here is what we use in our _common/common.runtime.properties:

druid.extensions.loadList=["druid-google-extensions"]
druid.extensions.localRepository=extensions-repo

# Deep storage
druid.storage.type=google
druid.google.bucket=some-example-bucket
druid.google.prefix=indexes


And we have druid-google-extensions-0.11.0.jar at extensions/druid-google-extensions/druid-google-extensions-0.11.0.jar

MONICA SINGH

unread,
Dec 13, 2017, 6:37:27 AM12/13/17
to Druid User
# Deep storage
druid.storage.type=google
druid.google.bucket=some-example-bucket
druid.google.prefix=indexes

Whether indexes is a folder inside the bucket 'some-example-bucket' or something else.

MONICA SINGH

unread,
Dec 13, 2017, 6:49:46 AM12/13/17
to Druid User

Erik Dubbelboer

unread,
Dec 14, 2017, 12:02:27 AM12/14/17
to Druid User
Yes indexes is a a folder in the bucket. So your segments would be in something like gs://some-example-bucket/indexes/datasourcename/segmentsetc
Reply all
Reply to author
Forward
0 new messages