Re: getting the metadata about the log files

28 views
Skip to first unread message

Partha Sud

unread,
Aug 31, 2021, 1:24:29 PM8/31/21
to Fluent Bit
Hello, 

We are using Fluent bit as a daemon set to forward infra related logs. We are able to successfully extract the logs per se. 

However, I am stuck while trying to retrieve the following info:
1. path of the log file. It is able to retrieve using /var/log/container/*whatwewant*, however we need the path of this log file as the source.
2. Name of the log file as the sourcetype., which we can perform regex on.
3. Podname on which this log file is present. 

Technically, I am able to have these values show up using event_source, event_source_type, event_host etc., but need to bring these values dynamically. 

Thanks,
Partha

Eduardo Silva

unread,
Sep 6, 2021, 7:09:19 PM9/6/21
to Partha Sud, Fluent Bit
there is a new feature in kubernetes filter for that use case, it might land in v1.8.7, if you want it to try now please clone the branch called "1.8-kube-meta-tag", full setup instructions in the latest commit



--
You received this message because you are subscribed to the Google Groups "Fluent Bit" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluent-bit+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fluent-bit/d864a1d6-1ea4-4c54-933c-2ec56fab956dn%40googlegroups.com.


--
Reply all
Reply to author
Forward
0 new messages