Help with configuration file

33 views
Skip to first unread message

manish...@admaxim.com

unread,
Apr 16, 2018, 2:18:30 AM4/16/18
to Fluentd Google Group
Hi there,

I am new to this group as well as fluentd. I wanted to set up configuration file but I am having difficulty in writing that. Below are my requirement.

We have application deployed on tomcat. This application generate application log every hour and the file format is filename.current date(%Y-%m-%d-%H). here hour is previous hour. example filename.2018-04-16-23

I want to look for this file and send to remote server once forwarded I want to remove this file from local server.

Another question about remote forward is I learn about out_forward output plugin which forward logs from one fluentd server to another how this communication happens.

How entire file will copy to another server at specific location?

Do we need to copy public_key to remote server for secure copy.

I am doing this thing in aws cloud environment. Please help me with configuration and which input plugin to use.

 

Mr. Fiber

unread,
Apr 19, 2018, 12:00:02 AM4/19/18
to Fluentd Google Group
Please help me with configuration and which input plugin to use.

If you want to reading file, you can use in_tail plugin.

How entire file will copy to another server at specific location?

But if you want to copy the file like scp, fluentd is not fit because
fluentd focuses on streaming manner, not batch.

in_tail -> out_forward -> in_forward -> out_file

Above is basic sequence for log forwarding from leaf server to central server.


Masahiro


--
You received this message because you are subscribed to the Google Groups "Fluentd Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages