A question about buffer flushing

[Hiroki Sakamoto]

Hi, thank you for developing a good product!

I have a question about flushing buffer in shutdown.

## Question

Is there a way to back up buffered logs to secondary when the buffer flush fails in process shutdown?

There is detailed as below.

## Situation

I operate fluentd containers in a kubernetes cluster.

When the node is shutdown, the pod is evicted.

If the destination is down at that time, 

the fluentd containers would fail to flush the buffered logs.

If there is no way to backup to secondary when flushing in shutdown is failed, the buffered would be lost.

Thank you for reading this question.

[Thomas Müller]

taish...@gmail.com schrieb am Donnerstag, 22. April 2021 um 06:12:41 UTC+2:

Hi, thank you for developing a good product!

I have a question about flushing buffer in shutdown.

## Question

Is there a way to back up buffered logs to secondary when the buffer flush fails in process shutdown?

have you tried to use a persistent buffer like the file buffer ? https://docs.fluentd.org/buffer/file so the buffer will survive a reboot or a fluentd restart.

Or to configure secondary output ? https://docs.fluentd.org/output/forward#example-configuration

There are probably many more ways to do it. :)

- Thomas