Td-agent not forwarding the log to another server

[abhishek...@indiamart.com]

Hi,
Rite now I m using ELASTICSEARCH, KIBANA with td-agent.
I am trying to parse and forward the error lof from one server to another via td-agent. Td-agent is parsing the log according to format but not sending them to another server. I Would also like to mention that rite now from this same config file setting i m able to take access and application log from this seerver to another server.
Only it is not sending the error log. my config file is as follows-
<source>
    type tail
    path /home/protected/runtime/application.log
    pos_file /var/log/td-agent/test3/td-agent.log.pos
    tag login.yii.applog
##    format none
    format multiline
    format_firstline /\d{4}\/\d{1,2}\/\d{1,2}/
    format1 /\d{4}\/\d{1,2}\/\d{1,2} \d{1,2}:\d{1,2}:\d{1,2} \[(?<level>.*)\] \[(?<type>.*)\] (?<Message1>.*)/
    format2 /(?<Message2>.*)/
    format3 /(?<Message3>.*)/
</source>

<match login.yii.**>
      type forward
      send_timeout 60s
      buffer_type file
      buffer_path /var/log/td-agent/test6/td-agent.buffer
      buffer_chunk_limit 8M
      buffer_queue_limit 128
      flush_interval 5s
      max_retry_wait 300
      disable_retry_limit
      recover_wait 10s
      heartbeat_type udp
      heartbeat_interval 1s
      phi_threshold 16
      retry_limit 50
      hard_timeout 60s
        <server>
            host 123.432.225.198
            port 24226
            weight 60
        </server>
    <secondary>
            type file
            path /var/log/td-agent/test6/td-agent-failed
      </secondary>
</match>

<match login.yii.**>
  type stdout
</match>

<source>
    type tail
    path /home32/statlogs/login-clickstream.log
    pos_file /var/log/td-agent/test1/td-agent.log.pos
    tag apache.login.access
    format /^(?<time>\S+)\s+(?<method>\S+)(?: +(?<path>\S+))?\s+(?<protocol>\S+)\s+(?<host>\S+)\s+(?<code>\S+)\s+(?<size>\S+)\s+(?<response_time>\S+)\s+(?<referer>\S+)\s+(?<agent>.*)?$/
    time_key time_local
    time_format "%Y%b%d%H%M%S"
</source>

<match apache.login.**>
      type forward
      send_timeout 60s
      buffer_type file
      buffer_path /var/log/td-agent/test1/td-agent.buffer
      buffer_chunk_limit 8M
      buffer_queue_limit 128
      flush_interval 5s
      max_retry_wait 300
      disable_retry_limit
      recover_wait 10s
      heartbeat_type udp
      heartbeat_interval 1s
      phi_threshold 16
      retry_limit 50
      hard_timeout 60s
        <server>
            host 123.432.225.198
            port 2422
            weight 60
        </server>
    <secondary>
            type file
            path /var/log/td-agent/test1/td-agent-failed
      </secondary>
</match>

<match apache.login.**>
  type stdout
</match>


<source>
  type tail
  path /var/log/td-agent/td-agent.log
  pos_file /var/log/td-agent/td-agent.log.pos
  tag debug.test
  format none
</source>

[Mr. Fiber]

> Only it is not sending the error log. 

Which is the setting for error log?

in_tail of multiline format?

Masahiro

https://www.youtube.com/watch?v=ch-1-DKUQcg 

--
You received this message because you are subscribed to the Google Groups "Fluentd Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[abhishek...@indiamart.com]

issues resolved.