Upgrade netty?

194 views
Skip to first unread message

cguil...@hotpads.com

unread,
Mar 24, 2017, 11:34:37 AM3/24/17
to Google Cloud Bigtable Discuss
Hello,

We would like to try bigtable with netty-tcnative version 2, as it brings a fix for https://github.com/netty/netty-tcnative/issues/151
But that version of netty-tcnative needs the last version of netty: 4.1.9.Final. Is there any plan to upgrade netty dependencies that are shaded?

Thank you,

Clément

Solomon Duskis

unread,
Mar 24, 2017, 12:00:26 PM3/24/17
to Google Cloud Bigtable Discuss
The Cloud Bigtable version of netty, protobuf and guava follow gRPC's upgrade path.  If gRPC upgrades netty, Cloud Bigtable will as well.  Our next release (hopefully next week) will depend on netty 4.1.8.Final.  We've had some obscure problems in the past with netty 4.1.3, so I'm hesitant to upgrade netty versions outside of the well trodden path for the majority of the customers

You can get around that with a dependency on bigtable-hbase rather than one of the bigtable-hbase-1.x dependencies and then explicitly depending on 4.1.9.Final to see if that works for you.  See here as an example of additional classes you'll need.

--
You received this message because you are subscribed to the Google Groups "Google Cloud Bigtable Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-bigtable-discuss+unsub...@googlegroups.com.
To post to this group, send email to google-cloud-bigtable-discuss@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-bigtable-discuss/41d9a6ff-8458-4d3c-b44f-098e5eea868c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--

Solomon Duskis | Google Cloud Bigtable Software Engineer | sdu...@google.com | 914-462-0531

cguil...@hotpads.com

unread,
Mar 24, 2017, 6:41:31 PM3/24/17
to Google Cloud Bigtable Discuss
I have some trouble getting grpc and netty 4.1.9.Final compatible because netty changed the visibility of the hpack decoder, that's used by GrpcHttp2HeadersDecoder, to private: https://github.com/zer0se7en/netty/pull/2/commits/f9001b9fc07a71a9d6eaf0462470416780302107


On Friday, March 24, 2017 at 9:00:26 AM UTC-7, Solomon Duskis wrote:
The Cloud Bigtable version of netty, protobuf and guava follow gRPC's upgrade path.  If gRPC upgrades netty, Cloud Bigtable will as well.  Our next release (hopefully next week) will depend on netty 4.1.8.Final.  We've had some obscure problems in the past with netty 4.1.3, so I'm hesitant to upgrade netty versions outside of the well trodden path for the majority of the customers

You can get around that with a dependency on bigtable-hbase rather than one of the bigtable-hbase-1.x dependencies and then explicitly depending on 4.1.9.Final to see if that works for you.  See here as an example of additional classes you'll need.
On Thu, Mar 23, 2017 at 8:10 PM, <cguil...@hotpads.com> wrote:
Hello,

We would like to try bigtable with netty-tcnative version 2, as it brings a fix for https://github.com/netty/netty-tcnative/issues/151
But that version of netty-tcnative needs the last version of netty: 4.1.9.Final. Is there any plan to upgrade netty dependencies that are shaded?

Thank you,

Clément

--
You received this message because you are subscribed to the Google Groups "Google Cloud Bigtable Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-bigtable-discuss+unsub...@googlegroups.com.
To post to this group, send email to google-cloud-b...@googlegroups.com.

Solomon Duskis

unread,
Mar 24, 2017, 6:43:28 PM3/24/17
to Google Cloud Bigtable Discuss
Ugh.  Sorry for your trouble.  It sounds like this is a better conversation to have with the gRPC team at https://github.com/grpc/grpc-java

To post to this group, send email to google-cloud-bigtable-discuss@googlegroups.com.
 To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-bigtable-discuss/ce1b46cd-5c93-4a64-9543-f23867fb5320%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

cguil...@hotpads.com

unread,
Apr 4, 2017, 1:42:44 AM4/4/17
to Google Cloud Bigtable Discuss
grpc and netty are going to work together and with tcnative 2 in next releases, we are really existed to use them with bigtable. Thank for your help.

Clément Guillaume

unread,
Jun 7, 2017, 4:27:00 PM6/7/17
to Google Cloud Bigtable Discuss

Hi,

gprc-java 1.4 is compatible with netty-tcnative 2 and has just been released.
It will be awesome when bigtable release with those recent version of grpc and netty.


Le lun. 3 avr. 2017 à 22:42, <cguil...@hotpads.com> a écrit :
grpc and netty are going to work together and with tcnative 2 in next releases, we are really existed to use them with bigtable. Thank for your help.


On Friday, March 24, 2017 at 3:43:28 PM UTC-7, Solomon Duskis wrote:
Ugh.  Sorry for your trouble.  It sounds like this is a better conversation to have with the gRPC team at https://github.com/grpc/grpc-java
On Fri, Mar 24, 2017 at 6:41 PM, <cguil...@hotpads.com> wrote:
I have some trouble getting grpc and netty 4.1.9.Final compatible because netty changed the visibility of the hpack decoder, that's used by GrpcHttp2HeadersDecoder, to private: https://github.com/zer0se7en/netty/pull/2/commits/f9001b9fc07a71a9d6eaf0462470416780302107

On Friday, March 24, 2017 at 9:00:26 AM UTC-7, Solomon Duskis wrote:
The Cloud Bigtable version of netty, protobuf and guava follow gRPC's upgrade path.  If gRPC upgrades netty, Cloud Bigtable will as well.  Our next release (hopefully next week) will depend on netty 4.1.8.Final.  We've had some obscure problems in the past with netty 4.1.3, so I'm hesitant to upgrade netty versions outside of the well trodden path for the majority of the customers

You can get around that with a dependency on bigtable-hbase rather than one of the bigtable-hbase-1.x dependencies and then explicitly depending on 4.1.9.Final to see if that works for you.  See here as an example of additional classes you'll need.
On Thu, Mar 23, 2017 at 8:10 PM, <cguil...@hotpads.com> wrote:
Hello,

We would like to try bigtable with netty-tcnative version 2, as it brings a fix for https://github.com/netty/netty-tcnative/issues/151
But that version of netty-tcnative needs the last version of netty: 4.1.9.Final. Is there any plan to upgrade netty dependencies that are shaded?

Thank you,

Clément

--
You received this message because you are subscribed to the Google Groups "Google Cloud Bigtable Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-bigtabl...@googlegroups.com.



--

Solomon Duskis | Google Cloud Bigtable Software Engineer | sdu...@google.com | 914-462-0531

--
You received this message because you are subscribed to the Google Groups "Google Cloud Bigtable Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-bigtabl...@googlegroups.com.

To post to this group, send email to google-cloud-b...@googlegroups.com.



--

Solomon Duskis | Google Cloud Bigtable Software Engineer | sdu...@google.com | 914-462-0531

--
You received this message because you are subscribed to a topic in the Google Groups "Google Cloud Bigtable Discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-cloud-bigtable-discuss/LvCdT4FGDl0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-cloud-bigtabl...@googlegroups.com.

To post to this group, send email to google-cloud-b...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-bigtable-discuss/fda573e8-a62f-496e-b0ca-292d32f10dae%40googlegroups.com.

Solomon Duskis

unread,
Jun 8, 2017, 1:26:19 PM6/8/17
to Google Cloud Bigtable Discuss


Solomon Duskis | Google Cloud Bigtable Tech Lead | sdu...@google.com | 914-462-0531

On Wed, Jun 7, 2017 at 4:26 PM, Clément Guillaume <cguil...@hotpads.com> wrote:

Hi,

gprc-java 1.4 is compatible with netty-tcnative 2 and has just been released.
It will be awesome when bigtable release with those recent version of grpc and netty.


Le lun. 3 avr. 2017 à 22:42, <cguil...@hotpads.com> a écrit :
grpc and netty are going to work together and with tcnative 2 in next releases, we are really existed to use them with bigtable. Thank for your help.


On Friday, March 24, 2017 at 3:43:28 PM UTC-7, Solomon Duskis wrote:
Ugh.  Sorry for your trouble.  It sounds like this is a better conversation to have with the gRPC team at https://github.com/grpc/grpc-java
On Fri, Mar 24, 2017 at 6:41 PM, <cguil...@hotpads.com> wrote:
I have some trouble getting grpc and netty 4.1.9.Final compatible because netty changed the visibility of the hpack decoder, that's used by GrpcHttp2HeadersDecoder, to private: https://github.com/zer0se7en/netty/pull/2/commits/f9001b9fc07a71a9d6eaf0462470416780302107

On Friday, March 24, 2017 at 9:00:26 AM UTC-7, Solomon Duskis wrote:
The Cloud Bigtable version of netty, protobuf and guava follow gRPC's upgrade path.  If gRPC upgrades netty, Cloud Bigtable will as well.  Our next release (hopefully next week) will depend on netty 4.1.8.Final.  We've had some obscure problems in the past with netty 4.1.3, so I'm hesitant to upgrade netty versions outside of the well trodden path for the majority of the customers

You can get around that with a dependency on bigtable-hbase rather than one of the bigtable-hbase-1.x dependencies and then explicitly depending on 4.1.9.Final to see if that works for you.  See here as an example of additional classes you'll need.
On Thu, Mar 23, 2017 at 8:10 PM, <cguil...@hotpads.com> wrote:
Hello,

We would like to try bigtable with netty-tcnative version 2, as it brings a fix for https://github.com/netty/netty-tcnative/issues/151
But that version of netty-tcnative needs the last version of netty: 4.1.9.Final. Is there any plan to upgrade netty dependencies that are shaded?

Thank you,

Clément

--
You received this message because you are subscribed to the Google Groups "Google Cloud Bigtable Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-bigtable-discuss+unsub...@googlegroups.com.



--

Solomon Duskis | Google Cloud Bigtable Software Engineer | sdu...@google.com | 914-462-0531

--
You received this message because you are subscribed to the Google Groups "Google Cloud Bigtable Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-bigtable-discuss+unsub...@googlegroups.com.

To post to this group, send email to google-cloud-b...@googlegroups.com.



--

Solomon Duskis | Google Cloud Bigtable Software Engineer | sdu...@google.com | 914-462-0531

--
You received this message because you are subscribed to a topic in the Google Groups "Google Cloud Bigtable Discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-cloud-bigtable-discuss/LvCdT4FGDl0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-cloud-bigtable-discuss+unsub...@googlegroups.com.
To post to this group, send email to google-cloud-bigtable-discuss@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-bigtable-discuss/fda573e8-a62f-496e-b0ca-292d32f10dae%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Google Cloud Bigtable Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-bigtable-discuss+unsub...@googlegroups.com.
To post to this group, send email to google-cloud-bigtable-discuss@googlegroups.com.
 To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-bigtable-discuss/CAJKZH7CqPr70o57vC49S4Do%2BWFkU1jBLQXPzfjytd8T2DPVDbw%40mail.gmail.com.

Solomon Duskis

unread,
Jun 9, 2017, 1:11:05 PM6/9/17
to Google Cloud Bigtable Discuss
I have some bad news, and some good news.

The bad news: It doesn't look like I can upgrade the netty and tcnative dependencies in the project itself.

The good news: I can upgrade grpc and protobuf.  We're also working on a fix for the overly complex shading logic that we do to make HBase work.  Once we remove the cloud-bigtable-client shading (by using hbase-shaded), you should be able to define use your own versions of netty and tcnative along with the new client.


Solomon Duskis | Google Cloud Bigtable Tech Lead | sdu...@google.com | 914-462-0531

Solomon Duskis

unread,
Jul 7, 2017, 7:57:49 AM7/7/17
to Google Cloud Bigtable Discuss
We released a new version of the client that will allow you to override the io.netty version from cloud-bigtable-hbase.  More information can be found here.
Reply all
Reply to author
Forward
0 new messages