jaegertracing warnings on high undertow-throughput

[Nicklas Karlsson]

Hi,

  Trying to bring down my REST-endpoint (latest WF EE 9 preview) to its knees in a performance test and I'm seeing some

20:35:10,900 WARN  [io.jaegertracing.internal.reporters.RemoteReporter] (jaeger.RemoteReporter-QueueProcessor) AppendCommand execution failed! Repeated errors of this command will not be logged.: io.jaegertracing.internal.exceptions.SenderException: Failed to flush spans.
        at io.jaegertr...@1.6.0//io.jaegertracing.thrift.internal.senders.ThriftSender.append(ThriftSender.java:76)
        at org.wildfly.extension.micro...@26.0.1.Final//org.wildfly.extension.microprofile.opentracing.spi.sender.WildFlySender.append(WildFlySender.java:38)
        at io.jaegertr...@1.6.0//io.jaegertracing.internal.reporters.RemoteReporter$AppendCommand.execute(RemoteReporter.java:143)
        at io.jaegertr...@1.6.0//io.jaegertracing.internal.reporters.RemoteReporter$QueueProcessor.run(RemoteReporter.java:182)
        at java.base/java.lang.Thread.run(Thread.java:831)
Caused by: io.jaegertracing.internal.exceptions.SenderException: Could not send 197 spans
        at io.jaegertr...@1.6.0//io.jaegertracing.thrift.internal.senders.UdpSender.send(UdpSender.java:86)
        at io.jaegertr...@1.6.0//io.jaegertracing.thrift.internal.senders.ThriftSender.flush(ThriftSender.java:114)
        at io.jaegertr...@1.6.0//io.jaegertracing.thrift.internal.senders.ThriftSender.append(ThriftSender.java:73)
        ... 4 more
Caused by: org.apache.thrift.transport.TTransportException: Cannot flush closed transport
        at io.jaegertr...@1.6.0//io.jaegertracing.thrift.internal.reporters.protocols.ThriftUdpTransport.flush(ThriftUdpTransport.java:151)
        at org.apac...@0.14.1//org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73)
        at org.apac...@0.14.1//org.apache.thrift.TServiceClient.sendBaseOneway(TServiceClient.java:66)
        at io.jaegertr...@1.6.0//io.jaegertracing.agent.thrift.Agent$Client.send_emitBatch(Agent.java:70)
        at io.jaegertr...@1.6.0//io.jaegertracing.agent.thrift.Agent$Client.emitBatch(Agent.java:63)
        at io.jaegertr...@1.6.0//io.jaegertracing.thrift.internal.senders.UdpSender.send(UdpSender.java:84)
        ... 6 more
Caused by: java.net.PortUnreachableException
        at java.base/sun.nio.ch.DatagramDispatcher.write0(Native Method)
        at java.base/sun.nio.ch.DatagramDispatcher.write(DatagramDispatcher.java:51)
        at java.base/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:113)
        at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:58)
        at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:50)
        at java.base/sun.nio.ch.DatagramChannelImpl.send(DatagramChannelImpl.java:794)
        at java.base/sun.nio.ch.DatagramChannelImpl.blockingSend(DatagramChannelImpl.java:849)
        at java.base/sun.nio.ch.DatagramSocketAdaptor.send(DatagramSocketAdaptor.java:217)
        at java.base/java.net.DatagramSocket.send(DatagramSocket.java:664)
        at io.jaegertr...@1.6.0//io.jaegertracing.thrift.internal.reporters.protocols.ThriftUdpTransport.flush(ThriftUdpTransport.java:149)
        ... 11 more

Is it something that needs to be addressed? Or can it even be addressed without disabling metrics?

--

Nicklas Karlsson, +358 40 5062266

Vaakunatie 10 as 7, 20780 Kaarina

[Emmanuel Hugonnet]

This is on the opentracing part, as it is trying to send traces to a Jaeger server.
The simplest way is to remove the opentracing subsystem.
Not sure about the performance impact though.
Regards,
emmanuel

> --
> You received this message because you are subscribed to the Google Groups "WildFly" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to wildfly+u...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/wildfly/CAFzcPXHHj7str%2BvwJsFjTLsn32qKAgKH%2BQHM6CmDegyYZMhYMQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/wildfly/CAFzcPXHHj7str%2BvwJsFjTLsn32qKAgKH%2BQHM6CmDegyYZMhYMQ%40mail.gmail.com?utm_medium=email&utm_source=footer>.