error_class="Elasticsearch::Transport::Transport::Error" error ="Cannot get new connection from pool

12 views
Skip to first unread message

elain ding

unread,
Nov 11, 2015, 6:13:28 PM11/11/15
to Elasticsearch ES
Hello everyone
I now deployed in the AWS EC2 td-agent, used to collect logs send to elasticsearch, found every about 6 hours, the log can not be normal collection, the newspaper is as follows:
#################################################
2015-11-11 18:06:37 +0800 [warn]: temporarily failed to flush the buffer. next_retry=2015-11-11 18:06:38 +0800 error_class="Elasticsearch::Transport::Transport::Error" error="Cannot get new connection from pool." plugin_id="object:124678c"
  2015-11-11 18:06:37 +0800 [warn]: /home/work/app/td-agent/embedded/lib/ruby/gems/2.1.0/gems/elasticsearch-transport-1.0.7/lib/elasticsearch/transport/transport/base.rb:179:in `perform_request'
  2015-11-11 18:06:37 +0800 [warn]: /home/work/app/td-agent/embedded/lib/ruby/gems/2.1.0/gems/elasticsearch-transport-1.0.7/lib/elasticsearch/transport/transport/http/faraday.rb:20:in `perform_request'
  2015-11-11 18:06:37 +0800 [warn]: /home/work/app/td-agent/embedded/lib/ruby/gems/2.1.0/gems/elasticsearch-transport-1.0.7/lib/elasticsearch/transport/client.rb:115:in `perform_request'
  2015-11-11 18:06:37 +0800 [warn]: /home/work/app/td-agent/embedded/lib/ruby/gems/2.1.0/gems/elasticsearch-api-1.0.7/lib/elasticsearch/api/actions/bulk.rb:80:in `bulk'
  2015-11-11 18:06:37 +0800 [warn]: /home/work/app/td-agent/etc/plugin/out_elasticsearch.rb:168:in `send'
  2015-11-11 18:06:37 +0800 [warn]: /home/work/app/td-agent/etc/plugin/out_elasticsearch.rb:161:in `write'
  2015-11-11 18:06:37 +0800 [warn]: /home/work/app/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.12.12/lib/fluent/buffer.rb:325:in `write_chunk'
  2015-11-11 18:06:37 +0800 [warn]: /home/work/app/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.12.12/lib/fluent/buffer.rb:304:in `pop'
  2015-11-11 18:06:37 +0800 [warn]: /home/work/app/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.12.12/lib/fluent/output.rb:321:in `try_flush'
  2015-11-11 18:06:37 +0800 [warn]: /home/work/app/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.12.12/lib/fluent/output.rb:140:in `run'
2015-11-11 18:06:38 +0800 [warn]: temporarily failed to flush the buffer. next_retry=2015-11-11 18:06:40 +0800 error_class="Elasticsearch::Transport::Transport::Error" error="Cannot get new connection from pool." plugin_id="object:124678c"
  2015-11-11 18:06:38 +0800 [warn]: suppressed same stacktrace
2015-11-11 18:06:40 +0800 [warn]: temporarily failed to flush the buffer. next_retry=2015-11-11 18:06:44 +0800 error_class="Elasticsearch::Transport::Transport::Error" error="Cannot get new connection from pool." plugin_id="object:124678c"
  2015-11-11 18:06:40 +0800 [warn]: suppressed same stacktrace
2015-11-11 18:06:44 +0800 [warn]: temporarily failed to flush the buffer. next_retry=2015-11-11 18:06:52 +0800 error_class="Elasticsearch::Transport::Transport::Error" error="Cannot get new connection from pool." plugin_id="object:124678c"
  2015-11-11 18:06:44 +0800 [warn]: suppressed same stacktrace
2015-11-11 18:06:52 +0800 [warn]: temporarily failed to flush the buffer. next_retry=2015-11-11 18:07:06 +0800 error_class="Elasticsearch::Transport::Transport::Error" error="Cannot get new connection from pool." plugin_id="object:124678c"
  2015-11-11 18:06:52 +0800 [warn]: suppressed same stacktrace
2015-11-11 18:07:06 +0800 [warn]: temporarily failed to flush the buffer. next_retry=2015-11-11 18:07:37 +0800 error_class="Elasticsearch::Transport::Transport::Error" error="Cannot get new connection from pool." plugin_id="object:124678c"
#################################################



My configuration is as follows:
#################################################
  type elasticsearch
  host 10.0.0.52
  port 9200
  path /
  logstash_format true
  utc_index false
  flush_interval 3s
  include_tag_key true
  tag_key tag
  buffer_type memory
  buffer_chunk_limit 256m
  buffer_queue_limit 128
  disable_retry_limit false
  retry_limit 17
  retry_wait 1s
  num_threads 5
#################################################

Help me see what is the cause?
Reply all
Reply to author
Forward
0 new messages