[fluent-plugin-webhdfs] snappy compression does not work

[In]

Hello,

Snappy does not work.. 

And Remove the compress option is works.

i got this error :

2017-02-20 17:10:06 +0900 [warn]: #0 failed to flush the buffer. retry_time=1 next_retry_seconds=2017-02-20 17:10:06 +0900 chunk="548f1a8c4ea17435dad5b74ba2cb6cc8" error_class=IOError error="closed stream"

2017-02-20 17:10:06 +0900 [warn]: #0 suppressed same stacktrace

2017-02-20 17:10:08 +0900 [warn]: #0 failed to communicate hdfs cluster, path: /log/data/2017/02/20/16/59/mylog01.log.sz

2017-02-20 17:10:08 +0900 [debug]: #0 taking back chunk for errors. chunk="548f1a8c4ea17435dad5b74ba2cb6cc8"

### env

#1. Debian 7

#2. CDH 5.10 HDFS

1. enable webhdfs
2. enable snappy codec 

#3. td-agent 2.3.4-0 (fluentd 0.14.12)

#4. fluent-plugin-webhdfs (1.1.0)

#5. snappy (0.0.15)

### configuration  

#1. /etc/td-agent/td-agent.conf:

<source>

  @type tail

  path /my_repo/log/test.log

  pos_file /my_repo/log/test.log.pos

  tag test.mylog01.log

  format none

</source>

<match test.mylog01.log>

  type forward

  time_as_integer true

  @log_level trace

  buffer_type file

  buffer_path /var/log/td-agent/buffer/mylog01.buffer

 

  <server>

    name fluentd-server

    host 10.10.10.133

    port 24224

  </server>

</match>

#2. /etc/td-agent/td-agent.conf:

<source>

 @type forward

 port 24224

 bind 0.0.0.0

</source>

<match test.mylog01.log>  

  @type webhdfs

 host hadoopnn0101

 port 50070

 path "/log/data/%Y/%m/%d/%H/%M/mylog01.log"

 time_slice_format %Y%m%d%H%M

 flush_interval 10s

 @log_level trace

 username hdfs

 compress snappy

</match>

3. td-agent-gem list

actionmailer (4.2.6)

actionpack (4.2.6)

actionview (4.2.6)

activejob (4.2.6)

activemodel (4.2.6)

activerecord (4.2.6)

activesupport (4.2.6)

addressable (2.5.0, 2.4.0)

appraisal (2.1.0)

arel (6.0.3)

aws-sdk (2.6.42)

aws-sdk-core (2.6.42)

aws-sdk-resources (2.6.42)

aws-sdk-v1 (1.66.0)

aws-sigv4 (1.0.0)

bigdecimal (1.2.4)

bson (1.12.5)

bson_ext (1.12.5)

builder (3.2.2)

bundler (1.10.6)

bzip2-ffi (1.0.0)

celluloid (0.15.2)

cool.io (1.4.5)

diff-lcs (1.2.5)

draper (1.4.0)

erubis (2.7.0)

ffi (1.9.14)

fluent-logger (0.6.1)

fluent-mixin-config-placeholders (0.4.0)

fluent-mixin-plaintextformatter (0.2.6)

fluent-plugin-kafka (0.4.1)

fluent-plugin-mongo (0.7.16)

fluent-plugin-rewrite-tag-filter (1.5.5)

fluent-plugin-s3 (0.8.0)

fluent-plugin-scribe (0.10.14)

fluent-plugin-td (0.10.29)

fluent-plugin-td-monitoring (0.2.2)

fluent-plugin-webhdfs (1.1.0)

fluentd (0.14.12)

fluentd-ui (0.4.3)

font-awesome-rails (4.6.3.0)

globalid (0.3.7, 0.3.6)

haml (4.0.7)

haml-rails (0.5.3)

hike (1.2.3)

hirb (0.7.3)

http_parser.rb (0.6.0)

httpclient (2.8.2.4)

i18n (0.7.0)

io-console (0.4.3)

ipaddress (0.8.3)

jbuilder (2.5.0)

jmespath (1.3.1)

jquery-rails (3.1.4)

json (1.8.1)

kramdown (1.11.0)

kramdown-haml (0.0.3)

loofah (2.0.3)

ltsv (0.1.0)

mail (2.6.4)

mime-types (3.1)

mime-types-data (3.2016.0521)

mini_portile2 (2.1.0)

minitest (5.9.0, 4.7.5)

mixlib-cli (1.7.0)

mixlib-config (2.2.4)

mixlib-log (1.7.1)

mixlib-shellout (2.2.7)

mongo (1.12.5)

msgpack (1.0.3, 0.5.11)

multi_json (1.11.0)

nokogiri (1.7.0)

ohai (6.20.0)

oj (2.18.0)

parallel (1.8.0)

power_assert (1.0.1)

psych (2.0.5)

public_suffix (2.0.4)

puma (3.4.0)

rack (1.6.4)

rack-test (0.6.3)

rails (4.2.6)

rails-deprecated_sanitizer (1.0.3)

rails-dom-testing (1.0.8)

rails-html-sanitizer (1.0.3)

railties (4.2.6)

rake (10.1.0)

rdoc (4.1.0)

request_store (1.1.0)

rr (1.2.0)

ruby-kafka (0.3.15)

ruby-progressbar (1.8.1)

rubyzip (1.2.0, 1.1.7)

sass (3.2.19)

sass-rails (4.0.5)

serverengine (2.0.4)

settingslogic (2.0.9)

sigdump (0.2.4)

snappy (0.0.15)

sprockets (2.12.4)

sprockets-rails (2.2.4)

string-scrub (0.0.5)

strptime (0.1.9)

sucker_punch (1.0.5)

systemu (2.5.2)

td (0.15.2)

td-client (0.8.85)

td-logger (0.3.26)

test-unit (3.2.3, 2.1.10.0)

test-unit-rr (1.0.5)

thor (0.19.1)

thread_safe (0.3.5)

thrift (0.8.0)

tilt (1.4.1)

timers (1.1.0)

tzinfo (1.2.2)

tzinfo-data (1.2016.10)

uuidtools (2.1.5)

webhdfs (0.8.0)

yajl-ruby (1.2.1)

zip-zip (0.3)