loading kafka extension locally instead of from maven repo?

[Brendan Clement]

I'm running druid on a machine which doesn't have access to the internet.  I'm Starting a local indexing service on your tutorial (loading your data)

The issue is i'm not able to start up an overlord node because it appears to be trying to pull the jar files from a maven repo. Is there an easy way to load kafka (extension) jars from a local path?

I run the following command:

java -Xmx2g -Duser.timezone=UTC -Dfile.encoding=UTF-8 -classpath lib/*;config/oerlord io.druid.cli.Main server overlord

2014-07-25 03:32:38,843 INFO [main] io.druid.server.initialization.PropertiesMod

ule - Loading properties from runtime.properties

2014-07-25 03:32:38,887 INFO [main] org.hibernate.validator.internal.util.Versio

n - HV000001: Hibernate Validator 5.0.1.Final

2014-07-25 03:32:39,516 INFO [main] io.druid.guice.JsonConfigurator - Loaded cla

ss[class io.druid.server.initialization.ExtensionsConfig] from props[druid.exten

sions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.drui

d.extensions:druid-kafka-seven:0.6.121], localRepository='C:\Users\bclement.PHX/

.m2/repository', remoteRepositories=[http://repo1.maven.org/maven2/, https://met

amx.artifactoryonline.com/metamx/pub-libs-releases-local]}]

2014-07-25 03:32:39,681 INFO [main] io.druid.initialization.Initialization - Loa

ding extension[io.druid.extensions:druid-kafka-seven:0.6.121] for class[io.druid

.cli.CliCommandCreator]

2014-07-25 03:34:00,050 ERROR [main] io.druid.initialization.Initialization - Un

able to resolve artifacts for [io.druid.extensions:druid-kafka-seven:jar:0.6.121

 (runtime) -> [] < [central (http://repo1.maven.org/maven2/, releases+snapshots)

,  (https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local, release

s+snapshots)]].

java.lang.NullPointerException

        at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDepen

dencies(DefaultRepositorySystem.java:361)

        at io.tesla.aether.internal.DefaultTeslaAether.resolveArtifacts(DefaultT

eslaAether.java:289)

        at io.druid.initialization.Initialization.getClassLoaderForCoordinates(I

nitialization.java:196)

        at io.druid.initialization.Initialization.getFromExtensions(Initializati

on.java:138)

        at io.druid.cli.Main.main(Main.java:80)

Exception in thread "main" java.lang.NullPointerException

        at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDepen

dencies(DefaultRepositorySystem.java:361)

        at io.tesla.aether.internal.DefaultTeslaAether.resolveArtifacts(DefaultT

eslaAether.java:289)

        at io.druid.initialization.Initialization.getClassLoaderForCoordinates(I

nitialization.java:196)

        at io.druid.initialization.Initialization.getFromExtensions(Initializati

on.java:138)

        at io.druid.cli.Main.main(Main.java:80)

[Brendan Clement]

Fixed it.

Just copied the ~/.m2 repository from another machine which had internet access.

Works beautifully.

Thanks

[Nishant Bangarwa]

Hi Brendan, 

you can specify a local repository or add the jars to the classpath manually. 

Steps are documented here on how to not let your setup download dependencies - 

http://druid.io/docs/0.6.121/Modules.html

--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-developm...@googlegroups.com.
To post to this group, send email to druid-de...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/066f6715-ad8f-4a5e-b592-ae8f71d0fcb0%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Nishant Software Engineer | METAMARKETS m  +91-9729200044 nishant....@metamarkets.com

[Brendan Clement]

Fixed it.

Just copied the ~/.m2 repository from another machine which had internet access.

Works beautifully.

Thanks

---

Date: Thu, 24 Jul 2014 20:40:16 -0700
From: brendan...@gmail.com
To: druid-de...@googlegroups.com
Subject: [druid-dev] loading kafka extension locally instead of from maven repo?

--
You received this message because you are subscribed to a topic in the Google Groups "Druid Development" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-development/flkEnd4yzi4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-developm...@googlegroups.com.

To post to this group, send email to druid-de...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/4ebd71a8-87b1-41f2-a7a1-d34da4302fd9%40googlegroups.com.