Jaeger UI HTTP Error

Zhang Zhao

unread,

Jul 9, 2021, 2:27:33 PM7/9/21

to Jaeger Tracing

Hi,

I am having a HTTP Error below after sending these testing spans. Could anyone advice? Thanks.

###############################################################

Jaeger UI started failing with:

HTTP Error: search services failed: elastic: Error 400 (Bad Request): all shards failed [type=search_phase_execution_exception]

###############################################################

Spans:

10:57:16.766 [alignElastic-3] INFO com.veeva.tracing.brave.support.LogSpanHandler - {"traceId":"9ff70187b1e0c42e","parentId":"9ff70187b1e0c42e","id":"4ff60bc7da341524","name":"hierarchy_alignment","timestamp":1625853436621966,"duration":143532,"localEndpoint":{"serviceName":"MockAlignmentApp","ipv4”:”xx.xx.xx.xx”}}

10:57:16.766 [alignElastic-3] INFO com.veeva.tracing.brave.support.LogSpanHandler - {"traceId":"9ff70187b1e0c42e","id":"9ff70187b1e0c42e","name":"alignment","timestamp":1625853435844793,"duration":921336,"localEndpoint":{"serviceName":"MockAlignmentApp","ipv4”:”xx”.xx.xx.xx},”tags":{"process_id":"dummyProcessId"}}

Albert Teoh

unread,

Jul 9, 2021, 8:31:04 PM7/9/21

to Jaeger Tracing

Hi,

It looks like an issue with Elasticsearch.

Could you check whether if services/spans are being saved into elasticsearch? i.e. you could try directly querying elasticsearch on the service index.

For example:

curl --location --request GET 'localhost:9200/jaeger-service*/_search/' \

--header 'Content-Type: application/json' \

--data-raw '{"aggregations":{"distinct_services":{"terms":{"field":"serviceName","size":10000}}},"size":0}'

If you see no results, I would work backwards, starting from the collector (run it with --log-level=debug and check logs), then agent.

Cheers,

Albert

Zhang Zhao

unread,

Jul 12, 2021, 12:12:35 PM7/12/21

to Albert Teoh, Jaeger Tracing

Thank you, Albert. I was not using the default 9200 port on Elasticsearch side. I had to add a flag to override the default port when starting up jaeger components. That was the issue.

Regards,

Zhang Zhao
zhang.a...@gmail.com
Cell: 201-600-6805

“Rest at the end, not in the middle"

--
You received this message because you are subscribed to a topic in the Google Groups "Jaeger Tracing" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/jaeger-tracing/tke3Y9HYwvY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to jaeger-tracin...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jaeger-tracing/ebc33059-60a0-4387-bfa6-c1baf0dec3f1n%40googlegroups.com.

Reply all

Reply to author

Forward