Traffic Monitoring of Debezium

[Jan Kopic]

Hello,
I would like to advise on monitoring debesium. We use Debezium version 1.7.0 for PostgreSQL 13.5. We have a large database with a capacity over that 30 TB and every month capacity increase over that 1TB. Debezium has setting the parameter snapshot_mode = never.

1. How can I keep track of how many changes I have left to read? How many changes I did read?

2. There is a chapter on Streaming metrics in the documentation https://debezium.io/documentation/reference/1.7/connectors/postgresql.html#postgresql-streaming-metrics

Unfortunately, it is not clear to me what to do with the command. Could someone explain or direct me?

Thank you very much,

Jan

[Chris Cranford]

Hi Jan -

With regards to (1), there currently isn't a way that I'm aware to obtain the number of pending events in the replication connection waiting to be read by Debezium.  However, we do expose the number of changes we have read, this is the TotalNumberOfEventsSeen [1] metric.

With regards to (2), we're simply detailing the bean naming and context needed to read the metrics from JMX.  Our monitoring documentation [2] shows how to enable JMX on the various Debezium images if you use those.  If you use other images you'll need to follow their appropriate documentation for exposing access to JMX.

Let us know if you have any other questions.

Chris

[1]: https://debezium.io/documentation/reference/connectors/postgresql.html#connectors-strm-metric-totalnumberofeventsseen_postgresql
[2]: https://debezium.io/documentation/reference/operations/monitoring.html

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/51935b5a-afad-4624-9a4f-544372bd60ecn%40googlegroups.com.