Prometheus Federation between AWS and GCP

[hemanth appu]

Hi,

      I am running a Kubernetes cluster in AWS and GCP , Currently I have separaate  Prometheus and Grafana for each cluster.  Is it possible to get the data from one cluster to another by using federation concept ?
 

[Stuart Clark]

Federation isn't designed for copying all data from one Prometheus
server to another. Instead it can be used as part of a hierarchical
Prometheus setup where you would pull certain aggregate metrics from
lower tier servers (often created via recording rules) to higher tier
servers. These higher tier servers can then have dashboards or alerts
that wouldn't be possible directly on the lower tier servers.

Another mechanism that can be used instead of (or as well as) federation
and hierarchical setups is the use of remote read & write. Using these
you can store all metrics in an external system (such as Thanos) which
can then be used to give a global query capability. There are various
options available which generally store the data in some form of
database or object storage system.

--
Stuart Clark