fluentbit as dameonset on Openshift

[Nicolas Pepinster]

Hello,

I would like to deploy fluentbit as a dameonset in my Openshift cluster and use the kubernetes filter.

I have a java container producing 4 types of logs : audit log, gc log, server log and syslog. 

To use fluentbit with k8s filter, I suppose that all types must be redirected (and mixed) to stdout of the container, right ?

Supposing that it's the case, how can route my log following their type (ex audit log needs to be archived on NFS but syslog just need to be dumped to a Elasticsearch cluster) ? Is it possible ? Need I change something in my log output (i.e wrapping it between recognizable tags or something ?)

NB : the fluentd salon at kubecon was very good :-)

Thanks in advance

[Eduardo Silva]

hi Nicolas, 

thanks for attending Fluentd Salon :)

> To use fluentbit with k8s filter, I suppose that all types must be redirected (and mixed) to stdout of the container, right ?

No, Fluent Bit can consume logs from different places, if they are in the file system, you can use the tail input plugin, so then the logs collected goes through the filter which appends the proper Kubernetes metadata.

In the following repository there is an example of the DaemonSet I am using for testing purposes:

https://github.com/fluent/fluent-bit-kubernetes-daemonset/tree/master/docker-image

The idea with Fluent Bit and Fluentd in general is that you don't change how your logs are generated, since both tools can adapt to different scenarios.

In order to provide you more details for your setup, would you please share a summary of your inputs and desired ouputs (backends)

regards, 

--
You received this message because you are subscribed to the Google Groups "Fluent-Bit" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluent-bit+unsubscribe@googlegroups.com.
To post to this group, send email to fluen...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fluent-bit/5f4e935f-6f53-4366-bd3e-05d0680ae899%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Eduardo Silva

Open Source, Treasure Data

http://www.treasuredata.com/opensource