Eventloop thread blocking after upgrading to 2.13.3.Final

401 views
Skip to first unread message

Pedro Igor

unread,
Oct 25, 2022, 3:33:26 PM10/25/22
to Quarkus Development mailing list
Hi,

After upgrading Quarkus to 2.13.3.Final in Keycloak, we start experiencing test failures in our GitHub Action Workflow indicating that the event loop thread is blocking:

```
2022-10-25 18:05:17,128 WARN [io.vertx.core.impl.BlockedThreadChecker] (vertx-blocked-thread-checker) Thread Thread[vert.x-eventloop-thread-0,5,main] has been blocked for 2136 ms, time limit is 2000 ms: io.vertx.core.VertxException: Thread blocked    at io.vertx.core.http.impl.Http1xServerRequest.onEnd(Http1xServerRequest.java:573)
```

For more details, you can look at the full log here https://github.com/pedroigor/keycloak/actions/runs/3323110014.

The issue can not be reproduced locally and we are still working to make it happen.

From what I've read so far, the `BlockedThreadChecker` is not always accurate about the  place where the code is blocking and the fact it is blocking on a `synchronized` block around the `Http1xServerConnection` is suspicious. 

Please, correct me if I'm wrong but the connection is shared across threads, right? Any idea about what might be causing that lock if it really makes sense?

I'm wondering if you have some hint about any change that might be causing that message to happen.

For now, we are downgrading Quarkus to 2.12.3.Final.

Best regards.
Pedro Igor

Pedro Igor

unread,
Oct 25, 2022, 4:57:45 PM10/25/22
to Quarkus Development mailing list
FTR, looks like the changes that reduced the default size of io/event-loop threads is impacting some of our tests.

After increasing the number of the thread pool, it seems to work fine.

Stuart Douglas

unread,
Oct 25, 2022, 7:44:41 PM10/25/22
to pigor.c...@gmail.com, Quarkus Development mailing list
Any way you can get a thread dump while this is happening? It looks like something is holding a long lived lock on the connection, which should not happen.

Stuart

--
You received this message because you are subscribed to the Google Groups "Quarkus Development mailing list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to quarkus-dev...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/quarkus-dev/4fea8abd-3dfc-405b-b167-26a54d15b846n%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages