transitivity of remote read/write api

23 views
Skip to first unread message

Johny

unread,
Feb 28, 2023, 7:46:38 AM2/28/23
to Prometheus Users
experimentally, I'm able to read data from downstream Prometheus instances with 3-4 levels between them. For example, consider this for simplicity
PromA   -----remote-read----> PromB ----remote-read-----> ExternalStorage

I am able to get data points in PromA that are fetched remotely from ExternalStorage. Similarly, I am able to write data points from PromA to ExternalStraoge.

Is there any caveat with this approach besides reliability issues in introducing multiple points of failure on the read/write path?


Julius Volz

unread,
Mar 1, 2023, 3:24:25 PM3/1/23
to Johny, Prometheus Users
The reliability issues are the only ones I can think of, but especially in the following sense:

* If only you have A->B and B cannot be reached while running a query from A, the query result will contain a warning about that which will also be shown in the graph UI.
* If you have A->B->C and C cannot be reached while running a query from A, that warning doesn't make it all the way back, so you just get an empty result set without the warning.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/d9ad025b-fbf8-4910-91d9-78aeebaf5dbcn%40googlegroups.com.


--
Julius Volz
PromLabs - promlabs.com
Reply all
Reply to author
Forward
0 new messages