How to make a multi format parser in fluent-bit

[naresh bhanawat]

Hi Experts,

there is a plugin in fluentd - 'fluent-plugin-multi-format-parser'

Do we have a similar plugin or way to achieve multi format parsing in fluent-bit?

Also, what if the logs are multi-line, and they have multiple formats and variable number of lines? All logs start with a particular date pattern, and there are 3 possible types of log entries capturing different information, which may contain stacktrace as well. Is there any parsing technique which can be used in fluentd/fluent-bit ??

Thanks,

Naresh

[Eduardo Silva]

hi Naresh, 

Fluent Bit have a filter called parser which allows configuring multiple parsers. Doing a simple test I've found that the configuration reader was only registering the first parser and not the others configured, I've fixed that in our GIT master branch and will be available shortly for our next release .

For now, in the meanwhile we release a new version please use multiple filter parser sections to accomplish the same thing.

best

--
You received this message because you are subscribed to the Google Groups "Fluent-Bit" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluent-bit+...@googlegroups.com.
To post to this group, send email to fluen...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fluent-bit/783cc020-5edb-42d8-9600-a20d803feb22%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Eduardo Silva

Open Source, Treasure Data

http://www.treasuredata.com/opensource