How to Read gz files using Fluentd

[its4...@gmail.com]

Hello 

how we can input gz files into td-agent 

my config file looks like below 

<source>

  type exec

  command sh /home/temp/unzip.sh /home/clduser/temp/test/ <---- shell command to unzip the .gz files

  run_interval 5s

  path /home/temp/test/**/*.log <----- to pick up files from two different folders

  read_from_head true

  tag snmplog

here the command is not getting executed any kind of help ?

Thanks 

Arun

[Mr. Fiber]

If you want to read gzip files in in_tail, no way.

Need to write your input plugin for it.

If you want to use in_exec, you need to puts one line log inside script:

https://docs.fluentd.org/v0.12/articles/in_exec#real-world-use-case-using-inexec-to-scrape-hacker-news-top-page

If you want to transfer exsiting gzip files to other place in batch way,

consider embulk or other bulk loading tool instead.

Masahiro

--
You received this message because you are subscribed to the Google Groups "Fluentd Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.