Force flushing buffered events

1,260 views
Skip to first unread message

Jack Xue

unread,
Oct 1, 2014, 11:41:35 AM10/1/14
to flu...@googlegroups.com
When and how will fluentd force flushing the buffer? How to monitor fluentd's buffer size to see any lag?

Thanks.

2014-10-01 03:07:01 -0400 [debug]: fluent/supervisor.rb:315:block in install_supervisor_signal_handlers: fluentd supervisor process get SIGUSR1
2014-10-01 03:07:01 -0400 [debug]: fluent/supervisor.rb:446:block in install_main_process_signal_handlers: fluentd main process get SIGUSR1
2014-10-01 03:07:01 -0400 [info]: fluent/supervisor.rb:447:block in install_main_process_signal_handlers: force flushing buffered events

Masahiro Nakagawa

unread,
Oct 1, 2014, 4:00:45 PM10/1/14
to flu...@googlegroups.com
Hi Jack,

When and how will fluentd force flushing the buffer?

fluentd flushes the buffer when receives USR1 signal.


And if you use memory buffer for BufferedOutput plugin,
fluentd flushes the buffer during shutdown phase.

How to monitor fluentd's buffer size to see any lag?


You can use in_monitor_agent plugin to check each plugin.

In addition, if you have a Treasure Data account, then
Treasure Agent Monitoring Service is an another option.



Thanks,
Masahiro


--
You received this message because you are subscribed to the Google Groups "Fluentd Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Gonzague Dambricourt

unread,
May 8, 2017, 7:54:30 AM5/8/17
to Fluentd Google Group
Hey Masahiro

In my logs at 6h25am every day I seem to get 
2017-05-08 06:25:01 +0200 [info]: #0 force flushing buffered events

Is it an expected behaviour ? :)

Thanks !

Gonzague 

Mr. Fiber

unread,
May 12, 2017, 9:24:43 AM5/12/17
to Fluentd Google Group
Is it an expected behaviour ? :)

It depends on your environment because its log is generated when fluentd got USR1 signal.


To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+unsubscribe@googlegroups.com.

Gonzague Dambricourt

unread,
May 14, 2017, 5:10:21 AM5/14/17
to flu...@googlegroups.com
Yeah but what generates this USR1 signal ?  


You received this message because you are subscribed to a topic in the Google Groups "Fluentd Google Group" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fluentd/JziEqHmafeA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to fluentd+u...@googlegroups.com.
signature.asc
Reply all
Reply to author
Forward
0 new messages