unable to see compaction metrics

21 views

Skip to first unread message

vishnu rao

unread,

Jul 22, 2015, 1:56:12 AM7/22/15

to Hannibal developers & users mailing list

i set up hannibal for our aws hbase 0.9.4 cluster but i am unable to see the compaction metrics.

The logs are confusing

1) initially from the logs - metrics are getting created, but 0 are getting updated.

2) Also after a while, the update compaction metrics operation starts but does not complete.

3) logs say no metrics for compaction found

any help on this would be appreciated.

thanks in advance.

-vishnu

here are the logs:

---------------------------------------------------------------------

156658981 [application-akka.actor.default-dispatcher-1165] INFO application - start updating CompactionMetrics... (Wed Jul 22 00:03:05 UTC 2015)

156659021 [application-akka.actor.default-dispatcher-1165] INFO application - Log file [http://....:60030/logs/hbase-hadoop-regionserver-__.log] seems to have rotated (server returned 416), resetting offset to 0

156659029 [application-akka.actor.default-dispatcher-1165] INFO application - Log file [http://...:60030/logs/hbase-hadoop-regionserver-__.log] seems to have rotated (server returned 416), resetting offset to 0

156659037 [application-akka.actor.default-dispatcher-1165] INFO application - Log file [http:/...:60030/logs/hbase-hadoop-regionserver-__.log] seems to have rotated (server returned 416), resetting offset to 0

156659055 [application-akka.actor.default-dispatcher-1165] INFO application - Log file [http://....internal:60030/logs/hbase-hadoop-regionserver__.log] seems to have rotated (server returned 416), resetting offset to 0

156659262 [application-akka.actor.default-dispatcher-1165] INFO application - Log file [http:/...:60030/logs/hbase-hadoop-regionserver-__.log] seems to have rotated (server returned 416), resetting offset to 0

156659274 [application-akka.actor.default-dispatcher-1165] INFO application - Log file [http:/....:60030/logs/hbase-hadoop-regionserver-__.log] seems to have rotated (server returned 416), resetting offset to 0

156659281 [application-akka.actor.default-dispatcher-1165] INFO application - Log file [http://....:60030/logs/hbase-hadoop-regionserver__.log] seems to have rotated (server returned 416), resetting offset to 0

156659285 [application-akka.actor.default-dispatcher-1165] INFO application - creating new metric for 96454d301c02457017c2f6cde25d4fde : compactions

156659285 [application-akka.actor.default-dispatcher-1165] INFO application - creating new metric for 9f72b5e379f8ea24191fc73f946fa8b4 : compactions

156659286 [application-akka.actor.default-dispatcher-1165] INFO application - creating new metric for 94923a185113b7e4a086c32bc5314123 : compactions

....

156659307 [application-akka.actor.default-dispatcher-1165] INFO application - completed updating 0 CompactionMetrics, took 326ms... (Wed Jul 22 00:03:06 UTC 2015)

---------------------------------------------------------------------

also i see the following:

177069441 [application-akka.actor.default-dispatcher-1306] INFO application - start updating CompactionMetrics... (Wed Jul 22 05:43:16 UTC 2015)

.....

177215970 [play-akka.actor.default-dispatcher-439] INFO application - no metrics found for : compactions

vishnu rao

unread,

Jul 23, 2015, 2:36:30 AM7/23/15

to Hannibal developers & users mailing list, jaihi...@gmail.com

so i was able to find out why updateCompaction metrics gets stuck.

the log file of 1 region server was not found by hannibal. fixed that.

now hannibal finds the logs and creates the metrics but

i get the following (updating 0 metrics):

608502 [application-akka.actor.default-dispatcher-5] INFO application - start updating CompactionMetrics... (Thu Jul 23 06:32:28 UTC 2015)

608643 [application-akka.actor.default-dispatcher-5] INFO application - completed updating 0 CompactionMetrics, took 140ms... (Thu Jul 23 06:32:28 UTC 2015)

not sure why ? any help would be appreciated.

------------------------the logs----------------------------------

308407 [application-akka.actor.default-dispatcher-4] INFO application - Initializing log offset to [0] for log file at http://......:60030/logs/hbase-hadoop-regionserver-....log with content-length [25446]

....

308413 [application-akka.actor.default-dispatcher-4] INFO application - creating new metric for d9a42287de8f801fce7b3064271f8639 : compactions

.....

608502 [application-akka.actor.default-dispatcher-5] INFO application - start updating CompactionMetrics... (Thu Jul 23 06:32:28 UTC 2015)

608643 [application-akka.actor.default-dispatcher-5] INFO application - completed updating 0 CompactionMetrics, took 140ms... (Thu Jul 23 06:32:28 UTC 2015)