hi group,
in order to insert path information into records, the most clean solution seems the in_tail_path plugin.
I installed the gem, but I can't seem to be able to activate it. I changed my td-agent config according to the documentation of the plugin, but at startup, td-agent keeps saying the corresponding plugin type (in_tail) is unknow. Although the gem is read:
2015-02-10 10:03:03 +0100 [info]: reading config file path="/etc/td-agent/td-agent.conf"
2015-02-10 10:03:03 +0100 [info]: starting fluentd-0.10.58
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-mixin-config-placeholders' version '0.3.0'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-mixin-plaintextformatter' version '0.2.6'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-plugin-elasticsearch' version '0.7.0'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-plugin-mongo' version '0.7.4'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-plugin-record-reformer' version '0.4.0'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '1.4.1'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-plugin-s3' version '0.5.1'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-plugin-scribe' version '0.10.14'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-plugin-tail_path' version '0.0.2'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-plugin-td' version '0.10.23'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-plugin-td-monitoring' version '0.2.0'
2015-02-10 10:03:03 +0100 [info]: gem 'fluent-plugin-webhdfs' version '0.4.1'
2015-02-10 10:03:03 +0100 [info]: gem 'fluentd' version '0.10.58'
2015-02-10 10:03:03 +0100 [info]: using configuration file: <ROOT>
<match fluentd.events>
type elasticsearch
logstash_format true
</match>
<source>
type tail_path
pos_file /var/log/td-agent/fluentd-events3.pos
format json
path /data/f_events/*.log
tag fluentd.events
read_from_head true
path_key true
</source>
</ROOT>
2015-02-10 10:03:03 +0100 [info]: adding source type="tail_path"
2015-02-10 10:03:03 +0100 [error]: config error file="/etc/td-agent/td-agent.conf" error="Unknown input plugin 'tail_path'. Run 'gem search -rd fluent-plugin' to find
plugins"Has anybody who has used this plugin a working config file example for me?
Who can explain how the type specification in the config (in this case: tail_path) relates to the plugin specification: how is the proper plugin picked by td-agent?
Ruud