Re: [VOTE] 3.0.0 RC2

[Bill Bejeck]

Hi Konstantine,

I've started to do the validation for the release and the link for docs doesn't work.

Thanks,

Bill

On Wed, Sep 8, 2021 at 5:59 PM Konstantine Karantasis <kkara...@apache.org> wrote:

Hello again Kafka users, developers and client-developers,

This is the third candidate for release of Apache Kafka 3.0.0.
It is a major release that includes many new features, including:

* The deprecation of support for Java 8 and Scala 2.12.
* Kafka Raft support for snapshots of the metadata topic and other
improvements in the self-managed quorum.
* Deprecation of message formats v0 and v1.
* Stronger delivery guarantees for the Kafka producer enabled by default.
* Optimizations in OffsetFetch and FindCoordinator requests.
* More flexible Mirror Maker 2 configuration and deprecation of Mirror
Maker 1.
* Ability to restart a connector's tasks on a single call in Kafka Connect.
* Connector log contexts and connector client overrides are now enabled by
default.
* Enhanced semantics for timestamp synchronization in Kafka Streams.
* Revamped public API for Stream's TaskId.
* Default serde becomes null in Kafka Streams and several other
configuration changes.

You may read and review a more detailed list of changes in the 3.0.0 blog
post draft here:
https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache6

Release notes for the 3.0.0 release:
https://home.apache.org/~kkarantasis/kafka-3.0.0-rc2/RELEASE_NOTES.html

*** Please download, test and vote by Tuesday, September 14, 2021 ***

Kafka's KEYS file containing PGP keys we use to sign the release:
https://kafka.apache.org/KEYS

* Release artifacts to be voted upon (source and binary):
https://home.apache.org/~kkarantasis/kafka-3.0.0-rc2/

* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/org/apache/kafka/

* Javadoc:
https://home.apache.org/~kkarantasis/kafka-3.0.0-rc2/javadoc/

* Tag to be voted upon (off 3.0 branch) is the 3.0.0 tag:
https://github.com/apache/kafka/releases/tag/3.0.0-rc2

* Documentation:
https://kafka.apache.org/30/documentation.html

* Protocol:
https://kafka.apache.org/30/protocol.html

* Successful Jenkins builds for the 3.0 branch:
Unit/integration tests:
https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/3.0/129/
(1 flaky test failure)
System tests: https://jenkins.confluent.io/job/system-test-kafka/job/3.0/67/
(1 flaky test failure)

/**************************************

Thanks,
Konstantine

[Bill Bejeck]

Hi Konstantine,

Thanks for that; I can get to the docs now.

I've validated the release by doing the following

• built from source
• ran all unit tests
• verified all checksums and signatures
• spot-checked the Javadoc
• worked through the quick start
• worked through the Kafka Streams quick start application
• ran KRaft in preview mode
• created a topic
• produced and consumed from the topic
• ran metadata shell

I did find some minor errors in the docs (all in quickstart)

• The beginning of the quickstart still references version 2.8
• The command presented to create a topic in the quickstart is missing the --partitions and --replication-factor params
• The link for "Kafka Streams demo" and "app development tutorial" points to version 2.5

But considering we can update the documentation directly and, more importantly, independently of the code, IMHO, I don't think these should block the release.

So it's a +1(binding) for me.

Thanks for running the release!

Bill

On Fri, Sep 10, 2021 at 2:36 AM Konstantine Karantasis <kkara...@apache.org> wrote:

Hi Bill,

I just added folder 30 to the kafka-site repo. Hadn't realized that this
separate manual step was part of the RC process and not the official
release (even though, strangely enough, I was expecting myself to be able
to read the docs online). I guess I needed a second nudge after Gary's
first comment on RC1 to see what was missing. I'll update the release doc
to make this more clear.

Should be accessible now. Please take another look.

Konstantine

[Randall Hauch]

Thanks for the RC, Konstantine.

I was able to successfully complete the following:

- Installed 3.0.0 RC2 and performed quickstart for broker and Connect
- Verified signatures and checksums
- Verified the tag
- Manually compared the release notes to JIRA
- Build release archive from the tag, ran Connect tests, installed locally, and ran a portion of quickstart

- Manually spotchecked the Javadocs linked above

- Verified the site docs at https://kafka.apache.org/30/documentation.html has the correct version references, except for the tar and cd commands in step 1 of the https://kafka.apache.org/30/documentation.html#quickstart. 

I think that last issue is minor and not worth another RC, since the other version references in https://kafka.apache.org/30/documentation.html do reference 3.0.0 and we can easily fix it on the website, optionally as part of the other post-vote changes to the site. If that's not intentional, then perhaps the Release Process steps could be changed to address this, since this also happened with 2.8.1 RC1.

So I'm +1 (binding)

Best regards,

Randall

On Mon, Sep 13, 2021 at 7:36 PM Colin McCabe <cmc...@apache.org> wrote:

Hi Konstantine,

I validated the RC by doing the following:

* Downloading the source and building using Java 11
* Running unit tests
* Setting up a three-node KRaft cluster in combined mode
* Testing creating a topic, producing and consuming from it, then restarting the kraft brokers
* Testing Kafka metadata shell

+1 (binding)

best,
Colin

On Fri, Sep 10, 2021, at 11:12, Bill Bejeck wrote:
> Hi Konstantine,
>
> Thanks for that; I can get to the docs now.
>
>
>
> I've validated the release by doing the following
>

>  * built from source
>  * ran all unit tests
>  * verified all checksums and signatures
>  * spot-checked the Javadoc
>  * worked through the quick start
>  * worked through the Kafka Streams quick start application
>  * ran KRaft in preview mode
>    * created a topic
>    * produced and consumed from the topic
>    * ran metadata shell

>
> I did find some minor errors in the docs (all in quickstart)
>

>  * The beginning of the quickstart still references version 2.8
>  * The command presented to create a topic in the quickstart is missing the --partitions and --replication-factor params
>  * The link for "Kafka Streams demo" and "app development tutorial" points to version 2.5

> --
> You received this message because you are subscribed to the Google Groups "kafka-clients" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to kafka-client...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/kafka-clients/CAF7WS%2BpTQ_qGfYwGMFC2i3cFPR%3DtMsGt039AQ9ve%3DPAaxc-UXw%40mail.gmail.com <https://groups.google.com/d/msgid/kafka-clients/CAF7WS%2BpTQ_qGfYwGMFC2i3cFPR%3DtMsGt039AQ9ve%3DPAaxc-UXw%40mail.gmail.com?utm_medium=email&utm_source=footer>.

[Israel Ekpo]

Hi Konstantine,

Thanks for running the release

I ran the following checks:

• PGP Signatures used to sign the release artifacts
• Validation of Release Artifacts Cryptographic Hashes (ASC MD5 SHA1 SHA512)
• Validation of Kafka Source and Tests
• Validation of Kafka Site Documentation
• Manual Check of Javadocs
• Validation of Cluster Setup for KRaft and Legacy Modes

+1 from me (non-binding)

To encourage other community members to participate in the release candidate validations and voting, I have set up the following resource as part of the work for KAFKA-9861

It is a set of scripts and Docker images that allows community members to run local validations in a consistent manner.

https://github.com/izzyacademy/apache-kafka-release-party

Please take a look at the resource and share any feedback that you may have.

I plan to create a video tutorial that walks community members through how it can be used soon. Stay tuned

[Konstantine Karantasis]

I'm also +1 (binding) given that: 

* I ran the release and generated RC2.
* Verified all checksums and signatures.
* Built and installed 3.0.0 RC2 from the source archive and the git tag.
* Spotchecked the Javadocs of RC2.
* Went through the documentation of 3.0.0 after RC2.

I confirm the minor differences in the documentation mentioned by Bill and Randall and I agree that these can be addressed directly to the docs repo and added to the source code as a follow-up in the 3.0 branch without requiring a new RC. I'll do that while promoting RC2 as the official 3.0.0 release.

Konstantine

On Wed, Sep 15, 2021 at 12:34 AM Israel Ekpo <israe...@gmail.com> wrote:

Hi Konstantine,

Thanks for running the release

I ran the following checks:

   - PGP Signatures used to sign the release artifacts
   - Validation of Release Artifacts Cryptographic Hashes (ASC MD5 SHA1
   SHA512)
   - Validation of Kafka Source and Tests
   - Validation of Kafka Site Documentation
   - Manual Check of Javadocs
   - Validation of Cluster Setup for KRaft and Legacy Modes

*+1 from me (non-binding)*

[Konstantine Karantasis]

This vote passes with 6 +1 votes (out of which 4 binding votes) and no 0 or -1 votes.

+1 votes
PMC Members:
* Bill Bejeck
* Colin McCabe
* Randall Hauch
* Konstantine Karantasis

Committers:
* No votes from additional committers

Community:
* Israel Ekpo
* Igor Soarez

0 votes
* No votes

-1 votes
* No votes

Vote thread:

https://lists.apache.org/thread.html/r57230f64abc755b8c0725a78fd479cb6624bdf6771e6df9850e27bdb%40%3Cdev.kafka.apache.org%3E
or
https://www.mail-archive.com/d...@kafka.apache.org/msg120900.html

I will continue with the release process and the release announcement will follow in the next few days.

Thanks everyone for your vote and confirmation of this release candidate.

Sincerely,
Konstantine Karantasis