Running Fluentd 0.14 in Windows

[bayetovsky]

Greetings,

I've recently tried installing fluentd 0.14 in a Windows test server (Win7) and i'm currently getting an error loading "window/library". Personally i'm not really that confortable working on Windows and may be missing something obvious so any assistance would be appreciated.

I've installed Ruby 2.2.4 via rubyinstaller and also installed the devkit from rubyinstaller page.

With those 2 components installed, I installed fluentd gem (and it's dependencies) with "-l" flag since the machine had no access to rubygems.

Are there any more requirements for Windows? Is there any official documentation regarding Windows installation since 0.14 was released? 

Details:

C:\Ruby22\bin>fluentd

C:/Ruby22/lib/ruby/2.2.0/rubygems/core_ext/kernel_require.rb:54:in `require': cannot load such file -- windows/library (LoadError)

        from C:/Ruby22/lib/ruby/2.2.0/rubygems/core_ext/kernel_require.rb:54:in `require'

        from C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:31:in `<top (required)>'

        from C:/Ruby22/lib/ruby/2.2.0/rubygems/core_ext/kernel_require.rb:54:in `require'

        from C:/Ruby22/lib/ruby/2.2.0/rubygems/core_ext/kernel_require.rb:54:in `require'

        from C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/comman d/fluentd.rb:19:in `<top (required)>'

        from C:/Ruby22/lib/ruby/2.2.0/rubygems/core_ext/kernel_require.rb:54:in `require'

        from C:/Ruby22/lib/ruby/2.2.0/rubygems/core_ext/kernel_require.rb:54:in `require'

        from C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/bin/fluentd:5:in `<top (required)>'

        from C:/Ruby22/bin/fluentd:23:in `load'

        from C:/Ruby22/bin/fluentd:23:in `<main>'

C:\Ruby22\bin>gem -v

2.4.5.1

C:\Ruby22\bin>ruby -v

ruby 2.2.4p230 (2015-12-16 revision 53155) [i386-mingw32]

C:\Ruby22\bin>gem env

RubyGems Environment:

  - RUBYGEMS VERSION: 2.4.5.1

  - RUBY VERSION: 2.2.4 (2015-12-16 patchlevel 230) [i386-mingw32]

  - INSTALLATION DIRECTORY: C:/Ruby22/lib/ruby/gems/2.2.0

  - RUBY EXECUTABLE: C:/Ruby22/bin/ruby.exe

  - EXECUTABLE DIRECTORY: C:/Ruby22/bin

  - SPEC CACHE DIRECTORY: C:/Users/IEUser/.gem/specs

  - SYSTEM CONFIGURATION DIRECTORY: C:/ProgramData

  - RUBYGEMS PLATFORMS:

    - ruby

    - x86-mingw32

  - GEM PATHS:

     - C:/Ruby22/lib/ruby/gems/2.2.0

     - C:/Users/IEUser/.gem/ruby/2.2.0

  - GEM CONFIGURATION:

     - :update_sources => true

     - :verbose => true

     - :backtrace => false

     - :bulk_threshold => 1000

  - REMOTE SOURCES:

     - https://rubygems.org/

  - SHELL PATH:

     - C:\Windows\system32

     - C:\Windows

     - C:\Windows\System32\Wbem

     - C:\Windows\System32\WindowsPowerShell\v1.0\

     - C:\Ruby22\bin

C:\Ruby22\bin>gem list

*** LOCAL GEMS ***

bigdecimal (1.2.6)

cool.io (1.4.3)

fluentd (0.14.0)

http_parser.rb (0.6.0)

io-console (0.4.3)

json (1.8.1)

minitest (5.4.3)

msgpack (0.7.0 x86-mingw32)

power_assert (0.2.2)

psych (2.0.8)

rake (10.4.2)

rdoc (4.2.0)

serverengine (1.6.4)

sigdump (0.2.4)

strptime (0.1.8)

test-unit (3.0.8)

thread_safe (0.3.5)

tzinfo (1.2.2)

tzinfo-data (1.2016.1)

yajl-ruby (1.2.1)

[Mr. Fiber]

Hi,

This is our mistake. We should release fluentd gem for windows environment.

For avoiding the problem, you need to install following additional gems manually:

https://github.com/fluent/fluentd/blob/master/fluentd.gemspec#L31

Masahiro

--
You received this message because you are subscribed to the Google Groups "Fluentd Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[bayetovsky]

Once again thanks for the quick reply.

Able to startup fluentd, but while using the default configuration i'm getting a loop with these errors:

2016-06-06 11:50:53 -0700 [info]: reading config file path="C:\\fluentd\\fluent.conf"

2016-06-06 11:50:53 -0700 [info]: starting fluentd-0.14.0

2016-06-06 11:50:53 -0700 [info]: spawn command to main: C:/Ruby22/bin/ruby.exe -Eascii-8bit:ascii-8bit  "C:/Ruby22/bin/fluentd" "-c" "C:\fluentd\fluent.conf" "-l" "C:\fluentd\fluent.log" --no-supervisor

2016-06-06 11:50:54 -0700 [info]: reading config file path="C:\\fluentd\\fluent.conf"

2016-06-06 11:50:54 -0700 [info]: starting fluentd-0.14.0 without supervision

2016-06-06 11:50:54 -0700 [info]: gem 'fluentd' version '0.14.0'

2016-06-06 11:50:54 -0700 [info]: adding match pattern="debug.**" type="stdout"

2016-06-06 11:50:54 -0700 [info]: adding match pattern="system.**" type="forward"

2016-06-06 11:50:54 -0700 [error]: unexpected error error="undefined method `to_sym' for nil:NilClass"

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/registry.rb:38:in `lookup'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/plugin.rb:146:in `new_impl'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/plugin.rb:104:in `new_output'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/plugin/output.rb:291:in `configure'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/plugin_helper/event_emitter.rb:60:in `configure'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/compat/output.rb:439:in `configure'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/plugin/out_forward.rb:101:in `configure'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/agent.rb:135:in `add_match'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/agent.rb:69:in `block in configure'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/agent.rb:63:in `each'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/agent.rb:63:in `configure'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/root_agent.rb:86:in `configure'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/engine.rb:119:in `configure'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/engine.rb:93:in `run_configure'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:576:in `run_configure'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:381:in `block in run_worker'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:509:in `call'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:509:in `main_process'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:378:in `run_worker'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/lib/fluent/command/fluentd.rb:266:in `<top (required)>'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/2.2.0/rubygems/core_ext/kernel_require.rb:54:in `require'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/2.2.0/rubygems/core_ext/kernel_require.rb:54:in `require'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/lib/ruby/gems/2.2.0/gems/fluentd-0.14.0/bin/fluentd:5:in `<top (required)>'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/bin/fluentd:23:in `load'

  2016-06-06 11:50:54 -0700 [error]: C:/Ruby22/bin/fluentd:23:in `<main>'

2016-06-06 11:50:54 -0700 [info]: Worker 0 finished unexpectedly with status 1

[Mr. Fiber]

This is bug of v0.14.0.

This will be fixed at v0.14.1 > https://github.com/fluent/fluentd/pull/1030

For now, setting "@type forward" in <secondary> resolve this problem.

[bayetovsky]

Setting the type in secondary entries solved the issue I was facing.

Quick question to sum this discussion up: is there any plugin (or recomendation) to consume windows event log?

[Mr. Fiber]

2 years ago, this user collects windows event log using https://github.com/okahashi117/fluent-plugin-winevtlog

I'm not sure this works with v0.14.

[bayetovsky]

Found that shortly after I had done the post (before that I had only found https://github.com/MasayukiKiyota/fluent-plugin-windows-eventlog ).

There seem to be some issues on that plugin but i've done a quick patch to work around them and it seems to be working so far.

Thanks for the assistance once more repeatedly.