How do I test blackbox exporter setup for Tomcat apps (running on Kubernetes/Istio)?

[Evelyn Pereira Souza]

Hi

Soon we will migrate from classic VMs to containers (k8s). In the first
step, I integrated all Tomcat apps into the blackbox exporter. Later I
will deploy Prometheus Operator.

Blackbox config

- parse with Regex the body

- check for non 200er

- POST a document and see http return code

- check for slow requests (probe_duration)

- send custom headers (App specific)

- query REST API

How do I test my Blackbox Exporter setup? I know that it works for
classic VMs, but I'm not sure if it detects all problems on k8s. Maybe
there are issues specific to Kubernetes and Istio service mesh?


For example, if I deleted all pods from a service, I got the following
response


status code 503:
no healthy upstream

Are there other things and use cases I should test / catch / expect?
What difference from a Java app perspective VMs vs. Containers?

best regards
Evelyn