Collector/Exporter Design Help

[Pavan Patharde]

Hi All,  

I have a situation where I am not able to solve this design problem.  I have ~10 services running on kubernetes with  each service exposing the metrics via java instrumentation.  Each service can have multiple pods which themselves will have some metrics like API Calls.  Prometheus server is hosted outside of k8s cluster.  We want to provide a single end point which can aggregate these metrics and expose in prometheus format.  I am thinking of multiple solutions but do not have any thing that’s mature. Any help here ?

[Julius Volz]

Normally I would advise you to run the Prometheus server in the cluster to make connectivity and such easier (and perhaps federate out some data to an external Prometheus server), but if you are stuck with only a Prometheus server outside of the cluster, maybe something like https://github.com/prometheus-community/PushProx could help?

On Mon, Jan 18, 2021 at 4:34 PM Pavan Patharde <pathar...@gmail.com> wrote:

Hi All,  

I have a situation where I am not able to solve this design problem.  I have ~10 services running on kubernetes with  each service exposing the metrics via java instrumentation.  Each service can have multiple pods which themselves will have some metrics like API Calls.  Prometheus server is hosted outside of k8s cluster.  We want to provide a single end point which can aggregate these metrics and expose in prometheus format.  I am thinking of multiple solutions but do not have any thing that’s mature. Any help here ?

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/d8e088ba-17f4-4257-a6ce-e84ef7676f48n%40googlegroups.com.

--

Julius Volz

PromLabs - promlabs.com

[Pavan Patharde]

Thank you for your reply @Julius Volz  since we will be having single Prometheus end point exposed from cluster, can Pushprox help ?

[Julius Volz]

I have actually never looked closely at PushProx before, but it looks like you actually don't have to be able to connect into the cluster at all, since the PushProx client component (which would live inside the cluster and scrape things) opens a connection to the PushProx proxy component (which would be outside the cluster), and then every time Prometheus scrapes the proxy, that scrape is proxied to the client, which executes the scrape and delivers the result back through the proxy.