how to monitor fluentd it's self?

[WD Wang]

hi,

How to monitor fluentd? like total message processed or total message in each tags?

[Felippe da Motta Raposo]

+1

Is there anyone monitoring td-agent's process state(stopped or started)?

2015-07-20 7:51 GMT-03:00 WD Wang <w...@wdicc.com>:

hi,

How to monitor fluentd? like total message processed or total message in each tags?

--
You received this message because you are subscribed to the Google Groups "Fluentd Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Mr. Fiber]

Here are several plugins to count messages:

https://github.com/tagomoris/fluent-plugin-flowcounter

https://github.com/sonots/fluent-plugin-flowcounter-simple

In addition, if you want to check the output plugin works or not, you can use in_monitor_agent.

http://docs.fluentd.org/articles/monitoring

Some users use fluentd with datadog for monitoring it.

https://www.datadoghq.com/blog/monitor-fluentd-datadog/

Of course, we can use other systems or softwares.

Masahiro

On Mon, Jul 20, 2015 at 7:51 PM, WD Wang <w...@wdicc.com> wrote:

hi,

How to monitor fluentd? like total message processed or total message in each tags?

--

[WD Wang]

Thanks, I'll try them.

在 2015年7月21日星期二 UTC+8上午7:15:05，repeatedly写道：

[Lance N.]

For counters, I used one of the counter plugins and then feed that into another one that does percentiles on a longer time sequence. These are saved for all of our apps. They go to another tag along with the name of the app.

For monitoring, we use Nagios with Python scripts, so I wrote a couple of those. I also have a script on each server with Fluentd that reports in every few minutes, and this goes to another log. This is useful because we're on Amazon with dynamic instances, so the number of Fluentd instances changes across the day.