fluent-plugin-sensu not able process huge data to Sensu port 3030

[Kishore]

Hi,

Collecting logs from Fluentd and pushing logs to Sensu port 3030 using fluent-plugin-sensu. Sending 100 logs per sec to Sensu port. Installed Wireshark to check the port performance. I check the timestamp of one message from wireshark and verified in Fluentd.log. I found that there is time delay and still some logs are in Fluentd.log which needs to push to Sensu Port. How can I improve the performance of Fluentd-sensu plugin. I know for every message sensu socket open and after write it closes. I tried to open socket to write all the data. But here Sensu port will flush all the data as singe hash and sensu client not able parse the Json and giving Json error.

Fluent sensu configuration.

<source>
  @type tail
 path /var/log/secure
  pos_file /var/log/fluentd/secure.pos
  tag secure_message
  format syslog
</source>

<match secure_message.**>
  type copy
  <store>
    @type stdout
  </store>
  <store>
    @type sensu
    server localhost
    port 3030
    check_handlers ["hostcollector"]
    check_name fluentd_log
        check_category SECURITY
    check_type metric
    check_status 0
    check_ttl 100
  </store>
</match>

[Mr. Fiber]

I'm not familiar with sensu, so I have simple question.

What the average throughput of import part of sensu?

I want to know which is the problem, fluent-plugin-sensu or sensu.

Can you import huge data without fluentd in one sec?

https://groups.google.com/forum/#!topic/sensu-users/4dPRqLr_7DM

From above thread, sensu seems to not focus on the performance.

Masahiro

--
You received this message because you are subscribed to the Google Groups "Fluentd Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.