Groups

flume-user

1–30 of 83

0 selected

11/29/17

Consume the Flume avro events from Kafka directly

Dear all, How can I consume the Flume events directly from Kafka in the Spark streaming? Please shed

unread,

Consume the Flume avro events from Kafka directly

Dear all, How can I consume the Flume events directly from Kafka in the Spark streaming? Please shed

11/29/17

8/31/17

Looking for a specific input on JMS source

We are designing a near-real time pipeline in which we will receive messages from IBM MQ. On the

unread,

Looking for a specific input on JMS source

We are designing a near-real time pipeline in which we will receive messages from IBM MQ. On the

8/31/17

Jason Moore, Roy Wang2

3/2/17

Apache Flume Java 8

I use flume1.7.0 with java 8. 在 2015年4月2日星期四 UTC+8下午11:59:25，JM写道： Does Apache Flume 1.5.0 or later

unread,

Apache Flume Java 8

I use flume1.7.0 with java 8. 在 2015年4月2日星期四 UTC+8下午11:59:25，JM写道： Does Apache Flume 1.5.0 or later

3/2/17

3/2/17

how to config http or socks proxy?

I want use flume to send client logs to server. I use the avro sink,but when client network has proxy

unread,

how to config http or socks proxy?

I want use flume to send client logs to server. I use the avro sink,but when client network has proxy

3/2/17

Christos Soulios

1/12/17

Throughput throttle

Hi everyone, I need to upload log files from my application servers to HDFS. However, I do not want

unread,

Throughput throttle

Hi everyone, I need to upload log files from my application servers to HDFS. However, I do not want

1/12/17

1/7/17

gather twitter data before and after a particular date.

Hi, I want huge number of tweets in two files Using flume. 1st file should consist of tweets before a

unread,

gather twitter data before and after a particular date.

Hi, I want huge number of tweets in two files Using flume. 1st file should consist of tweets before a

1/7/17

1/7/17

Flume configurations to get all data in one file.

Hi, I am trying to gather a million tweets related to some specific topics, I am generating the

unread,

Flume configurations to get all data in one file.

Hi, I am trying to gather a million tweets related to some specific topics, I am generating the

1/7/17

Xiaotian Zhang2

12/9/16

Slow kansas write

Thanks for the pointer! I will go over it. On Fri, Dec 9, 2016 at 4:24 PM, Andy Schneider <

unread,

Slow kansas write

Thanks for the pointer! I will go over it. On Fri, Dec 9, 2016 at 4:24 PM, Andy Schneider <

12/9/16

Xiaotian Zhang2

11/22/16

Seems I find an example here, will try this. Thanks. On Tue, Nov 22, 2016 at 2:04 PM, Xiaotian Zhang

unread,

Seems I find an example here, will try this. Thanks. On Tue, Nov 22, 2016 at 2:04 PM, Xiaotian Zhang

11/22/16

praya...@gmail.com

11/8/16

ElasticsearchSink/ElasticSearchLogStashEventSerializer inserting "java memomy address" instead of json object

I wrote a flume interceptor that reads each log event and transforms into required log event, with

unread,

ElasticsearchSink/ElasticSearchLogStashEventSerializer inserting "java memomy address" instead of json object

I wrote a flume interceptor that reads each log event and transforms into required log event, with

11/8/16

6/15/16

Flume FileChannel eviction policy

Hi I have custom event generator and i am using file channel. Source commit the events to channel

unread,

Flume FileChannel eviction policy

Hi I have custom event generator and i am using file channel. Source commit the events to channel

6/15/16

5/9/16

Cannot run even the trivial exec -> file_roll example

agent.sinks.k1.sink.directory = /home/me/out.txt <- should be a directory here. What surprises me

unread,

Cannot run even the trivial exec -> file_roll example

agent.sinks.k1.sink.directory = /home/me/out.txt <- should be a directory here. What surprises me

5/9/16

3/17/16

Flume in Cloudera 5.4.2: Avro block size is invalid or too large when using Flume and Twitter streaming

Hi there, I am a Flume user. Now I am using Flume from Cloudera 5.4.2. Base on this article Apache

unread,

Flume in Cloudera 5.4.2: Avro block size is invalid or too large when using Flume and Twitter streaming

Hi there, I am a Flume user. Now I am using Flume from Cloudera 5.4.2. Base on this article Apache

3/17/16

Christopher Tignor

3/14/16

Injecting a RandomBase into a DoFn

Hello, I'd like to inject a RandomBase into my DoFn class in order to be able to provide mocks

unread,

Injecting a RandomBase into a DoFn

Hello, I'd like to inject a RandomBase into my DoFn class in order to be able to provide mocks

3/14/16

2/5/16

Any way to force fuse stages?

Hi everyone, I couldn't find an answer anywhere and decided to ask here: is there a way to force

unread,

Any way to force fuse stages?

Hi everyone, I couldn't find an answer anywhere and decided to ask here: is there a way to force

2/5/16

1/25/16

Flume: Customize sink for receiving log on predictionio

Dear all, I am trying to config Flume sink for receiving log on PredictionIO event server. My web

unread,

Flume: Customize sink for receiving log on predictionio

Dear all, I am trying to config Flume sink for receiving log on PredictionIO event server. My web

1/25/16

Alexander Orwell Wolf

1/20/16

integration flum + mongodb

Hello, someone can help me with: integration flume + mongodb o maybe someone has experience used this

unread,

integration flum + mongodb

Hello, someone can help me with: integration flume + mongodb o maybe someone has experience used this

1/20/16

أنس الليثي

11/17/15

What is the suitable Flume source to consume stream like twitter stream

Dear In our flume agent, we are using flume executing command source to consume tweets from twitter.

unread,

What is the suitable Flume source to consume stream like twitter stream

Dear In our flume agent, we are using flume executing command source to consume tweets from twitter.

11/17/15

أنس الليثي

10/25/15

How to override the Elasticsearch sink client?

I are using Flume for ingesting data into Elasticsearch and I need to change the default behavior of

unread,

How to override the Elasticsearch sink client?

I are using Flume for ingesting data into Elasticsearch and I need to change the default behavior of

10/25/15

9/23/15

I am getting error while using HbaseAysncSink with Flume NG, any idea any body??

2015-09-23 02:00:13499 (lifecycleSupervisor-1-9) [ERROR - org.apache.flume.lifecycle.

unread,

I am getting error while using HbaseAysncSink with Flume NG, any idea any body??

2015-09-23 02:00:13499 (lifecycleSupervisor-1-9) [ERROR - org.apache.flume.lifecycle.

9/23/15

Arun Sundar Selvan

9/11/15

Consume Remote syslog TCP using Flume

Hi All, I'm trying to consume remote syslogtcp data through Flume. PFB the conf and the error.

unread,

Consume Remote syslog TCP using Flume

Hi All, I'm trying to consume remote syslogtcp data through Flume. PFB the conf and the error.

9/11/15

7/2/15

flume is not working with ASN.1 format

Hello All, I am new in flume. My use case is to read files which are in ASN.1 format but getting

unread,

flume is not working with ASN.1 format

Hello All, I am new in flume. My use case is to read files which are in ASN.1 format but getting

7/2/15

6/25/15

Why does an optional flume channel cause a non-optional flume channel to have problems?

I have what seems to be a simple Flume configuration that is giving me a lot of problems. Let me

unread,

Why does an optional flume channel cause a non-optional flume channel to have problems?

I have what seems to be a simple Flume configuration that is giving me a lot of problems. Let me

6/25/15

6/3/15

A way to chain selectors?

Hi, is there any easy way to implement such chain single source getting event multiplexing selector

unread,

A way to chain selectors?

Hi, is there any easy way to implement such chain single source getting event multiplexing selector

6/3/15

5/8/15

question using java flume throttler qps

Hi I would like to confirm that the qps passed to context.getThrottler(the specified global rate) is

unread,

question using java flume throttler qps

Hi I would like to confirm that the qps passed to context.getThrottler(the specified global rate) is

5/8/15

5/6/15

What is the best practice to perform data validation?

Hello Flume-users, I work on a team that frequently uses data pipelines written in FlumeJava, and

unread,

What is the best practice to perform data validation?

Hello Flume-users, I work on a team that frequently uses data pipelines written in FlumeJava, and

5/6/15

4/23/15

flume count behavior

Hi Flume experts, I want to confirm the behavior of "count" function over PCollection.

unread,

flume count behavior

Hi Flume experts, I want to confirm the behavior of "count" function over PCollection.

4/23/15

3/30/15

support for Kafka Source

Hi, regarding this issue: https://issues.apache.org/jira/browse/FLUME-2250 If I understand correctly

unread,

support for Kafka Source

Hi, regarding this issue: https://issues.apache.org/jira/browse/FLUME-2250 If I understand correctly

3/30/15

3/12/15

How to inject more complicated logic within CombineValues

Hi flume experts, here is what I am trying to do. First, I go though all the cafe conversion logs and

unread,

How to inject more complicated logic within CombineValues

Hi flume experts, here is what I am trying to do. First, I go though all the cafe conversion logs and

3/12/15

Smain Kahlouch2

2/10/15

Rsyslog to HDFS through Flume servers: Data lost :(

Ok, i don't know why but it seems to be caused by the hdfs sink. I've change my configuration

unread,

Rsyslog to HDFS through Flume servers: Data lost :(

Ok, i don't know why but it seems to be caused by the hdfs sink. I've change my configuration

2/10/15

Search

Clear search

Close search

Google apps

Main menu