Maven repo for confluent artifacts

[Rajasekar Elango]

The maven repo url http://packages.confluent.io/maven/  documented in installation guide seem to be empty and invalid. Can you provide correct maven repo url for importing confluent artifacts via maven?

Thanks,
Raja.

[Ewen Cheslack-Postava]

Rajasekar,

Can you describe what you're trying to do that isn't working? The repository is working fine from various projects for me, including the quickstart instructions.

-Ewen

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/3ed67b42-db5f-4458-8aaa-c735186d6eb8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

[Rajasekar Elango]

I added to this my pom.xml:

    <repositories>
        <repository>
            <id>confluent</id>
            <url>http://packages.confluent.io/maven/</url>
        </repository>
    </repositories>

    <dependencies>
       <dependency>
            <groupId>org.apache.kafka</groupId>
            <artifactId>kafka_2.10</artifactId>
            <version>0.8.2.0-cp</version>
       </dependency>

    </dependencies>

but getting the error Dependency '''org.apache.kafka:kafka_2.10:0.8.2.0-cp''' not found. Also when I hit http://packages.confluent.io/maven/ via browser, I get empty file.

Thanks,
Raja.

On Wednesday, 24 June 2015 14:28:07 UTC-4, Ewen Cheslack-Postava wrote:

Rajasekar,

Can you describe what you're trying to do that isn't working? The repository is working fine from various projects for me, including the quickstart instructions.

-Ewen

On Tue, Jun 23, 2015 at 12:14 PM, Rajasekar Elango <e.raj...@gmail.com> wrote:

The maven repo url http://packages.confluent.io/maven/  documented in installation guide seem to be empty and invalid. Can you provide correct maven repo url for importing confluent artifacts via maven?

Thanks,
Raja.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/3ed67b42-db5f-4458-8aaa-c735186d6eb8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

[Ewen Cheslack-Postava]

Unless I'm missing a typo, I just tested exactly that in a fresh VM (no cached mvn artifacts) and it found the org.apache.kafka:kafka_2.10:0.8.2.0-cp artifact just fine.

Could you try running mvn with the -U flag to force it to recheck for the dependency? Sometimes the "missing" package gets cached if you forgot to add the repository but added the dependency (so it couldn't be found in Central) or even if there was some other temporary network failure. The -U flag should force it to try downloading again. You might have to take extra steps to make this work if you have another maven cache (e.g. Artifactory, Archiva, etc).

If that doesn't work, maybe include the output of your maven command with -X, which might include more useful debug info about what's going wrong?

-Ewen

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/3ed67b42-db5f-4458-8aaa-c735186d6eb8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

--

You received this message because you are subscribed to the Google Groups "Confluent Platform" group.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/5abe4eae-2ee7-47f3-ba73-fda460e133bf%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

[Rajasekar Elango]

Thanks Ewen, Maven requests are proxy-ed through our internal nexus maven server. It appears that our internal nexus can download third party artifacts only from maven central. Is it possible to have this artifacts pushed to maven central?

Thanks,

Raja.

--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/efHQvLFKRKk/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAE1jLMOFN2YqSeUYzd5QVcK-OXndbEDbhpaPFf8S78dpamO_5w%40mail.gmail.com.

[Ewen Cheslack-Postava]

I'm pretty sure we can't do this with the Kafka artifacts without messing with the Maven coordinates since org.apache.kafka is already used (rightly so) by the Apache Kafka project to publish its artifacts. We're careful not to change versions so we don't create conflicts, but as far as I know the way Central handles publication of artifacts wouldn't permit this. For Kafka specifically, you can just use 0.8.2.1 from Central -- we had to tag a different version for our release because it occurred before the Apache Kafka 0.8.2.1 release, but they are exactly equivalent.

-Ewen

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACcs26%3D2YHhVfsi7dAjVj6cFnT%2BjUTfLCrrPWvv_cSLbopO-Fg%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

[Rajasekar Elango]

Sure, I can get kafka dependency from maven central. But how about kafka-rest and schema-registry, Can those be made available in maven central as there won't be any conflict?

Thanks,

Raja.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAE1jLMOW0ouTfBHfZhpRnc1b2faU8AK9%3D5dzTZnX7ZPuMoSRAA%40mail.gmail.com.

[Peter Davis]

Bump.  Any hope of pushing io.confluent.* artifacts like kafka-avro-serializer and kafka-schema-registry-client to Maven Central?  Including source jars?

My organization also proxies Maven Central and getting 3rd party repos proxied is rather a bureaucratic pain.  I hear this is not unusual.

Related: http://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/2.0.1/kafka-avro-serializer-2.0.1-sources.jar does not exist.

-Peter

Thanks,
Ewen

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/5abe4eae-2ee7-47f3-ba73-fda460e133bf%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

-- 

--

Thanks,
Ewen

-- 

[David Chen]

Try https instead.

[Sumanth B]

Hi,

 

I was unable to get the jar for kafka-connect-avro-converter with the following lines added to my build.sbt file

resolvers ++=Seq("confluent" at "http://packages.confluent.io/maven/")

libraryDependencies ++= Seq("io.confluent" % "kafka-connect-avro-converter" % "2.0.1")

I also tried for different version like 2.1.0-alpha1,3.0.0-SNAPSHOT etc ,but none of them are working.Any clue to solve this will be very helpful.

[Liquan Pei]

Hi Sumanth,

Can you try libraryDependencies ++= Seq("io.confluent" % "avro-converter" % "2.0.1")

Thanks,

Liquan

--

You received this message because you are subscribed to the Google Groups "Confluent Platform" group.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/bf5d621f-b25c-43e3-a21e-ee0beff27e8d%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Liquan Pei | Software Engineer | Confluent | +1 413.230.6855

Download Apache Kafka and Confluent Platform: www.confluent.io/download

[Michael Richardson]

I am having the same issue with accessing kafka-avro-serializer through sbt. I can access 1.0 as follows. However, updating to the latest version 3.0.0, it doesn't work. Is there a way to browse the confluent repo to see what is there? 

libraryDependencies ++= Seq(
  "org.apache.spark" %% "spark-core" % "1.6.1" % "provided",
  "org.apache.spark" %% "spark-streaming" % "1.6.1",
  "org.apache.spark" %% "spark-streaming-kafka" % "1.6.1",
  "org.apache.spark" %% "spark-sql" % "1.6.1",
  "io.confluent" % "kafka-avro-serializer" % "1.0",
  "org.scalactic" %% "scalactic" % "2.2.6",
  "org.scalatest" %% "scalatest" % "2.2.6" % "test"
)

resolvers ++= Seq(
  Resolver.sonatypeRepo("public"),
  Resolver.url("confluent", url("http://packages.confluent.io/maven/"))
)

I tried using https and "io.confluent" % "avro-converter" % "2.0.1" but they didn't work for me. 

The error with 3.0.0 was: 

[error] (spark/*:update) sbt.ResolveException: unresolved dependency: io.confluent#kafka-avro-serializer;3.0.0: not found
[error] (spark/*:ssExtractDependencies) sbt.ResolveException: unresolved dependency: io.confluent#kafka-avro-serializer;3.0.0: not found
[error] Total time: 10 s, completed Jun 27, 2016 10:27:38 AM

Thanks, 

Michael 

[Michael Richardson]

I have found that changing the resolver to "Confluent Maven Repo" at "http://packages.confluent.io/maven/" works in SBT to access kafka-avro-serializer 3.0.0. 

libraryDependencies ++= Seq(
  "org.apache.spark" %% "spark-core" % "1.6.1" % "provided",
  "org.apache.spark" %% "spark-streaming" % "1.6.1",
  "org.apache.spark" %% "spark-streaming-kafka" % "1.6.1",

  "io.confluent" % "kafka-avro-serializer" % "3.0.0",

  "org.scalactic" %% "scalactic" % "2.2.6",
  "org.scalatest" %% "scalatest" % "2.2.6" % "test"
)

resolvers ++= Seq(
  Resolver.sonatypeRepo("public"),

  "Confluent Maven Repo" at "http://packages.confluent.io/maven/"
)

[Yancy Yue]

I met the same problem when I compiling io.confluent.streams-example, Eclipse can not download some jars from confluent maven repository.

Could not resolve dependencies for project io.confluent:streams-examples:jar:3.1.0-SNAPSHOT: The following artifacts could not be resolved: io.confluent:kafka-avro-serializer:jar:3.1.0-SNAPSHOT, io.confluent:kafka-schema-registry-client:jar:3.1.0-SNAPSHOT, org.apache.kafka:kafka-clients:jar:0.10.1.0-SNAPSHOT, org.apache.kafka:kafka-streams:jar:0.10.1.0-SNAPSHOT, org.apache.kafka:kafka_2.11:jar:0.10.1.0-SNAPSHOT, org.apache.kafka:kafka_2.11:jar:test:0.10.1.0-SNAPSHOT, org.apache.kafka:kafka-clients:jar:test:0.10.1.0-SNAPSHOT, io.confluent:kafka-schema-registry:jar:3.1.0-SNAPSHOT, io.confluent:kafka-schema-registry:jar:tests:3.1.0-SNAPSHOT: Could not find artifact io.confluent:kafka-avro-serializer:jar:3.1.0-SNAPSHOT in confluent (http://packages.confluent.io/maven/) -> [Help 1]

And when I visit http://packages.confluent.io/maven, It return  Wrong Key.

But when I remove the suffix “-SNAPSHOT” in the pom file, everything is ok.

It seems that the webservice of confluent maven repo is ok, it only wont list the files.


在 2015年6月24日星期三 UTC+8上午3:14:52，Rajasekar Elango写道：

[Michael Noll]

FYI: At the moment we are not publishing any snapshot artifacts (like 3.1.0-SNAPSHOT) to our public Confluent maven repository, hence the "Could not resolve" errors when attempting to use 3.1.0-SNAPSHOT.

And yes, as others have mentioned in this thread, the Confluent maven repository happens to be not browsable.

--

You received this message because you are subscribed to the Google Groups "Confluent Platform" group.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/e2e1d4ca-0990-40b8-95f3-f197db4d3712%40googlegroups.com.

[Koert Kuipers]

can we make this repo browsable? this game of trying to guess what is on the maven repo is silly

On Wednesday, November 9, 2016 at 5:08:34 AM UTC-5, Michael Noll wrote:

FYI: At the moment we are not publishing any snapshot artifacts (like 3.1.0-SNAPSHOT) to our public Confluent maven repository, hence the "Could not resolve" errors when attempting to use 3.1.0-SNAPSHOT.

And yes, as others have mentioned in this thread, the Confluent maven repository happens to be not browsable.

On Wed, Nov 9, 2016 at 3:23 AM, Yancy Yue <yue....@gmail.com> wrote:

I met the same problem when I compiling io.confluent.streams-example, Eclipse can not download some jars from confluent maven repository.

Could not resolve dependencies for project io.confluent:streams-examples:jar:3.1.0-SNAPSHOT: The following artifacts could not be resolved: io.confluent:kafka-avro-serializer:jar:3.1.0-SNAPSHOT, io.confluent:kafka-schema-registry-client:jar:3.1.0-SNAPSHOT, org.apache.kafka:kafka-clients:jar:0.10.1.0-SNAPSHOT, org.apache.kafka:kafka-streams:jar:0.10.1.0-SNAPSHOT, org.apache.kafka:kafka_2.11:jar:0.10.1.0-SNAPSHOT, org.apache.kafka:kafka_2.11:jar:test:0.10.1.0-SNAPSHOT, org.apache.kafka:kafka-clients:jar:test:0.10.1.0-SNAPSHOT, io.confluent:kafka-schema-registry:jar:3.1.0-SNAPSHOT, io.confluent:kafka-schema-registry:jar:tests:3.1.0-SNAPSHOT: Could not find artifact io.confluent:kafka-avro-serializer:jar:3.1.0-SNAPSHOT in confluent (http://packages.confluent.io/maven/) -> [Help 1]

And when I visit http://packages.confluent.io/maven, It return  Wrong Key.

But when I remove the suffix “-SNAPSHOT” in the pom file, everything is ok.

It seems that the webservice of confluent maven repo is ok, it only wont list the files.


在 2015年6月24日星期三 UTC+8上午3:14:52，Rajasekar Elango写道：

The maven repo url http://packages.confluent.io/maven/  documented in installation guide seem to be empty and invalid. Can you provide correct maven repo url for importing confluent artifacts via maven?

Thanks,
Raja.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

[Warren Kiser]

Any updates on making the maven repo browsable? Randomly guessing what artifacts are available is silly.

[Hadi Salem]

Failing to add the repo http://packages.confluent.io/maven to our JFrog Artifactory ... this issue needs to be fixed, as a workaround I forked the code and published it to my local JFrog server

[gvdm]

Hi all,

any update on this issue? It seems that it is not possible to mirror the Confluent Maven repository on a JFrog Artifactory repo and this is a issue when the only Maven repository we can use is the company one (Artifactory).

Thank you

Regards

[gvdm]

I add some details.

I added the confluent Maven repo http://packages.confluent.io to the internal Artifactory repository.

The problem is that when I try to compile a Maven project which references kafka-avro-serializer the build fails because it cannot find the artifact.

So it seems that the Confluent repo is not mirrored by the Artifactory server.

What do you think? Have you ever experienced this issue?

Thanks