S3 Plugin - Error while trying to access S3

[Darvin Denmian]

Hi guys,

apparently this output plugin loves me, this is my second question

regarding the same plugin :(

Well, I'm facing a problem that I really don't know how to solve. I deployed 

an instance on AWS and attached to it an AWS Role that allows free access S3 resource, this way there is no need to specify secret/access in the "td-agent.conf". But as you might imagine it's not working, below the output:

[LOG]

/var/log/td-agent# 2014-12-24 09:31:13 -0200 [error]: fluent/engine.rb:234:rescue in run: unexpected error error_class=RuntimeError error=#<RuntimeError: can't call S3 API. Please check your aws_key_id / aws_sec_key or s3_region configuration>

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluent-plugin-s3-0.5.1/lib/fluent/plugin/out_s3.rb:142:in `rescue in check_apikeys'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluent-plugin-s3-0.5.1/lib/fluent/plugin/out_s3.rb:138:in `check_apikeys'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluent-plugin-s3-0.5.1/lib/fluent/plugin/out_s3.rb:83:in `start'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/match.rb:40:in `start'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/engine.rb:263:in `block in start'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/engine.rb:262:in `each'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/engine.rb:262:in `start'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/engine.rb:213:in `run'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/supervisor.rb:477:in `run_engine'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/supervisor.rb:142:in `block in start'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/supervisor.rb:268:in `call'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/supervisor.rb:268:in `main_process'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/supervisor.rb:243:in `block in supervise'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/supervisor.rb:242:in `fork'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/supervisor.rb:242:in `supervise'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/supervisor.rb:136:in `start'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/lib/fluent/command/fluentd.rb:168:in `<top (required)>'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/site_ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/site_ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.10.58/bin/fluentd:6:in `<top (required)>'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/bin/fluentd:23:in `load'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /opt/td-agent/embedded/bin/fluentd:23:in `<top (required)>'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /usr/sbin/td-agent:7:in `load'

  2014-12-24 09:31:13 -0200 [error]: fluent/supervisor.rb:142:block in start: /usr/sbin/td-agent:7:in `<main>'

2014-12-24 09:31:13 -0200 [info]: fluent/engine.rb:237:run: shutting down fluentd

2014-12-24 09:31:13 -0200 [info]: fluent/supervisor.rb:258:supervise: process finished code=0

2014-12-24 09:31:13 -0200 [warn]: fluent/supervisor.rb:261:supervise: process died within 1 second. exit.

[LOG]

# Fluent Version

2.1.3-0 

# S3 plugin version

fluent-plugin-s3 (0.5.1)

# Configuration

<match api.autocompletelog.**>

  type s3

  s3_bucket logs

  s3_region sa-east-1

  path autocompletelog/

  time_slice_format %Y%m%d%H

  utc

  buffer_chunk_limit 10m

  buffer_queue_limit 512

  flush_interval 10m

  retry_wait 20s

  buffer_path /var/log/fluent/autocompletelog

</match>

Any idea? Suggestion?

[Darvin Denmian]

Sorry guys for asking such a dumb question...

I just found the solution:

check_apikey_on_start false

Thanks

[Mr. Fiber]

Hmm... I will add error class information to log message.

Masahiro

--
You received this message because you are subscribed to the Google Groups "Fluentd Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.