prometheus-grafana metrics

[arvi docs]

Hi Team,

I am trying to setup cassandra monitoring using jmx-exporter, prometheus and grafana and I took help from:

https://github.com/thelastpickle/tlp-cluster

I got json files to import to grafana but came to know that most of metrics names in grafana dashboards are not present in what jmx-exports populate.

For example, there is no metric name "org_apache_cassandra_metrics_clientrequest_oneminuterate" that you used in cassandra-overview dashboard for "Request Throughputs" panel.

The formula is :

"sum by (scope, environment, cluster) (org_apache_cassandra_metrics_clientrequest_oneminuterate{scope=~"Read|Write|CASRead|CASWrite|RangeSlice|ViewRead|ViewWrite", name=~"Latency|ViewWriteLatency", environment="$environment", cluster="$cluster", datacenter=~"$datacenter", rack=~"$rack", node=~"$node"})"

So as, "org_apache_cassandra_metrics_threadpools_value" metrics.

I've used:
jmx_prometheus_javaagent-0.3.0.jar

prometheus-2.0.0.linux-amd64.tar.gz
Grafana 3.1.1

Thanks.

[arvi docs]

I removed contents from yaml file, and seems like it is showing all metrics now. I just kept these 3 lines in the yaml:

lowercaseOutputLabelNames: true

lowercaseOutputName: true

startDelaySeconds: 0

Now, struck at template label values, 

For ex, prometheus is unable to fetch vales for: label_values(org_apache_cassandra_metrics_clientrequest_oneminuterate, environment)

[Arvi Sea]

Hi Team,

Could someone please help me to find what is the "environment" template variable:

label_values(org_apache_cassandra_metrics_clientrequest_oneminuterate, environment)

My dashboard shows nothing in the drop down. Same is the case for cluster, rack and node.

Do I need to change any config to get the value?

Thanks.