Fluentd Config File Viewer, Editor or Plugin

[Sahil Gupta]

Hello,

Currently I am using Fluentd whose configuration file has unfortunately become very large for my use case. This becomes very hard to manage the config file. Are there any known plugins, editors or viewers for Fluentd configuration file which add syntax highlighting, automatic indentation, documentation on Fluentd plugins in-built, etc? One example could be something like this (very basic): https://github.com/syohex/emacs-fluentd-mode

1. Also, how do you manage your config files (mine is currently >1000 lines long)?

2. Is there usually a way to minimize the config size that I may be missing - e.g. out_forest plugin helped us. May be there are others which achieve this? I am primarily using it for syncing logs in multiple CSV files across S3, local disk, etc. Currently, the schema of each CSV file causes the configuration to become cumbersome/large.

Regards,

Sahil

[Lance N.]

I use the include format to scan a directory and load every file it finds. Each file has its own input plugin and submits prepared data to a common sender tag. I have not changed the main file in several months. I have only added new files to the subdirectory.

@include /etc/td-agent/parts/*.conf

I'm up to 10 files now and each is 40-70 lines long. It's still understandable.

[Yaroslav Brahinets]

I had also a huge config file, but then forest plugin helped me to economize a lot of space 

May be if you have a lot of similar configs, look at forest plugin for templating. https://github.com/tagomoris/fluent-plugin-forest

четверг, 5 мая 2016 г., 23:34:18 UTC+3 пользователь Sahil Gupta написал: