How to build 0.22.0?

Jacek Laskowski

unread,

Dec 5, 2021, 9:33:15 AM12/5/21

to ksqldb-users

Hi,

This is my first attempt at building a branch and it failed with missing dependencies issue. The master worked fine.

I cloned the repo and switched to v0.22.0-ksqldb branch. Is this the correct one for the 0.22.0 release?

When executed, ./mvnw clean package -DskipTests (as described in CONTRIBUTING.md) I got the following error:

[ERROR] The build could not read 1 project -> [Help 1]

[ERROR]

[ERROR] The project io.confluent.ksql:ksqldb-parent:0.22.0 (/Users/jacek/dev/oss/ksql/pom.xml) has 1 error

[ERROR] Non-resolvable parent POM for io.confluent.ksql:ksqldb-parent:0.22.0: io.confluent:common:pom:7.1.0-beta210918170926 was not found in https://packages.confluent.io/maven/ during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of confluent has elapsed or updates are forced and 'parent.relativePath' points at wrong local POM @ line 19, column 13 -> [Help 2]

That makes sense since I cannot find 7.1.0-beta210918170926 dependencies at https://packages.confluent.io/maven/ either.

It looks like I'm missing something important.

I changed pom.xml to reference 7.0.0 version of io.confluent.common parent.

That let me go past building ksqldb-parent, ksqldb-test-util and ksqldb-udf modules. and failed at ksqldb-common:

[ERROR] Failed to execute goal on project ksqldb-common: Could not resolve dependencies for project io.confluent.ksql:ksqldb-common:jar:0.22.0: io.confluent:kafka-connect-avro-converter:jar:7.1.0-beta210918170926 was not found in https://packages.confluent.io/maven/ during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of confluent has elapsed or updates are forced -> [Help 1]

Is it only me who's running into these build issues? What's the proper way to build the latest version of ksqldb 0.22.0?

Pozdrawiam,

Jacek Laskowski

----

https://books.japila.pl/

Natea Eshetu Beshada

unread,

Dec 17, 2021, 4:54:19 PM12/17/21

to ksqldb-users

Hi Jacek,

I am not sure why building from that branch does not work. However, when I looked at CONTRIBUTING.md just now, it said to build a released version to use tags (not the branch), so I would recommend trying that to see if that will work for you. Here is the link to the steps: https://github.com/confluentinc/ksql/blob/master/CONTRIBUTING.md#building-a-released-version

Jacek Laskowski

unread,

Dec 17, 2021, 6:58:29 PM12/17/21

to Natea Eshetu Beshada, ksqldb-users

Hi Natea,

Thank you so much for answering my question!

I tried what you recommended and here is what it gave me:

$ git fetch origin --tags

$ git checkout 0.23.1-ksqldb

[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]

[ERROR] The project io.confluent.ksql:ksqldb-parent:0.23.1-rc10 (/Users/jacek/dev/oss/ksql/pom.xml) has 1 error
[ERROR] Non-resolvable parent POM for io.confluent.ksql:ksqldb-parent:0.23.1-rc10: Could not transfer artifact io.confluent:common:pom:7.1.0-cc-docker-ksql.17-634-rc2 from/to confluent-other (https://confluent.jfrog.io/confluent/maven-releases-stabilization): authentication failed for https://confluent.jfrog.io/confluent/maven-releases-stabilization/io/confluent/common/7.1.0-cc-docker-ksql.17-634-rc2/common-7.1.0-cc-docker-ksql.17-634-rc2.pom, status: 401 Unauthorized and 'parent.relativePath' points at wrong local POM @ line 29, column 13 -> [Help 2]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException

Can you help me resolve it?

Pozdrawiam,

Jacek Laskowski

----

https://about.me/JacekLaskowski

"The Internals Of" Online Books

Follow me on https://twitter.com/jaceklaskowski

--
You received this message because you are subscribed to the Google Groups "ksqldb-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ksql-users+...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/ksql-users/3cee24f6-a606-4c25-9b10-4856aaa1ed86n%40googlegroups.com.

Natea Eshetu Beshada

unread,

Dec 17, 2021, 7:52:54 PM12/17/21

to Jacek Laskowski, ksqldb-users

Ah sorry, this will probably work as intended if you try v0.22.0-ksqldb, since that was the last release with our old pipeline. WIth the latest release, there are still kinks we are ironing out with the new release pipeline. So in the meantime, please try this tag, v0.23.1-rc10

$ git fetch origin --tags

$ git checkout v0.23.1-rc10

$ ./mvnw --settings maven-settings.xml clean package -DskipTests

Jacek Laskowski

unread,

Dec 18, 2021, 7:28:18 AM12/18/21

to Natea Eshetu Beshada, ksqldb-users

Hi Natea,

Sorry. It does not work either.

$ git show head

commit cb1df937b393ff57f428308b64abdf595a36e0c9 (HEAD -> v0.23.1-rc10, tag: v0.23.1-rc10)
Author: Confluent Jenkins <jen...@confluent.io>
Date: Sun Dec 12 20:41:18 2021 +0000

Update next release candidate for cc-docker-ksql.17

...

$ git checkout v0.23.1-rc10
$ ./mvnw --settings maven-settings.xml clean package -DskipTests

[INFO] Scanning for projects...
Downloading from confluent-other: https://confluent.jfrog.io/confluent/maven-releases-stabilization/io/confluent/common/7.1.0-cc-docker-ksql.17-634-rc2/common-7.1.0-cc-docker-ksql.17-634-rc2.pom

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common/7.1.0-cc-docker-ksql.17-634-rc2/common-7.1.0-cc-docker-ksql.17-634-rc2.pom

[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[WARNING] 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.commons:commons-compress:jar -> duplicate declaration of version ${commons.compress.version} @ line 460, column 25
[FATAL] Non-resolvable parent POM for io.confluent.ksql:ksqldb-parent:0.23.1-rc10: Could not transfer artifact io.confluent:common:pom:7.1.0-cc-docker-ksql.17-634-rc2 from/to confluent-other (https://confluent.jfrog.io/confluent/maven-releases-stabilization): authentication failed for https://confluent.jfrog.io/confluent/maven-releases-stabilization/io/confluent/common/7.1.0-cc-docker-ksql.17-634-rc2/common-7.1.0-cc-docker-ksql.17-634-rc2.pom, status: 401 Unauthorized and 'parent.relativePath' points at wrong local POM @ line 29, column 13
@
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR] The project io.confluent.ksql:ksqldb-parent:0.23.1-rc10 (/Users/jacek/dev/oss/ksql/pom.xml) has 1 error
[ERROR] Non-resolvable parent POM for io.confluent.ksql:ksqldb-parent:0.23.1-rc10: Could not transfer artifact io.confluent:common:pom:7.1.0-cc-docker-ksql.17-634-rc2 from/to confluent-other (https://confluent.jfrog.io/confluent/maven-releases-stabilization): authentication failed for https://confluent.jfrog.io/confluent/maven-releases-stabilization/io/confluent/common/7.1.0-cc-docker-ksql.17-634-rc2/common-7.1.0-cc-docker-ksql.17-634-rc2.pom, status: 401 Unauthorized and 'parent.relativePath' points at wrong local POM @ line 29, column 13 -> [Help 2]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException

Pozdrawiam,

Jacek Laskowski

----

https://about.me/JacekLaskowski

"The Internals Of" Online Books

Follow me on https://twitter.com/jaceklaskowski

Jacek Laskowski

unread,

Dec 18, 2021, 8:20:22 AM12/18/21

to Natea Eshetu Beshada, ksqldb-users

Hi,

BTW, the master works just fine.

$ git show head

commit df29d27707de96dcce97f81e76c98f225a7442d2 (HEAD -> master)
Author: Walker Carlson <18128741+...@users.noreply.github.com>
Date: Thu Dec 16 10:37:17 2021 -0600

feat: new runtime selection (#8472)

$ ./mvnw clean package -DskipTests

...

[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 10:01 min
[INFO] Finished at: 2021-12-18T13:39:45+01:00
[INFO] ------------------------------------------------------------------------

Pozdrawiam,

Jacek Laskowski

----

https://about.me/JacekLaskowski

"The Internals Of" Online Books

Follow me on https://twitter.com/jaceklaskowski

Natea Eshetu Beshada

unread,

Dec 18, 2021, 11:44:06 AM12/18/21

to Jacek Laskowski, ksqldb-users

I see, thank you for the updates. Sorry, but again this is another issue with our new release pipeline. Right now the url we that we publish our dependency tree jars to for our release is not public. This is something we intend to fix after the holidays by deploying them to a public url.

--

Thanks,

Natea

Jacek Laskowski

unread,

Dec 20, 2021, 7:03:54 AM12/20/21

to Natea Eshetu Beshada, ksqldb-users

Hi Natea,

Thanks for such a quick response! I appreciate it.

Are this and other tasks that the ksqldb team is working on somewhere public?

Pozdrawiam,

Jacek Laskowski

----

https://about.me/JacekLaskowski

"The Internals Of" Online Books

Follow me on https://twitter.com/jaceklaskowski

Natea Eshetu Beshada

unread,

Dec 20, 2021, 12:40:21 PM12/20/21

to Jacek Laskowski, ksqldb-users

No problem. The ksql GitHub issues sections tracks most of the work we are doing. There are some things such as the release pipeline that aren’t tracked there but only internally unfortunately.

--

Thanks,

Natea

Natea Eshetu Beshada

unread,

Feb 9, 2022, 7:12:20 PM2/9/22

to Jacek Laskowski, ksqldb-users

Hi Jacek,

Thank you for your patience as we transitioned our release pipeline. You should now be able to build the 0.23.1 ksqldb branch with the following commands.

git fetch origin

git checkout 0.23.1-ksqldb

./mvnw --settings maven-settings.xml clean package -DskipTests

Note that this is the branch and not the tag. We will publish new tags for the 0.23.1 release so that you can also build from those, hopefully by this week.

Reply all

Reply to author

Forward