Consume Remote syslog TCP using Flume

[Arun Sundar Selvan]

Hi All,

I'm trying to consume remote syslogtcp data through Flume. PFB the conf and the error. Help me in resolving this.


Conf:
a1.sources = tcp_source
a1.sinks = flume_avro_agent1 flume_avro_agent2
a1.channels = file_channel
a1.sinkgroups = load-balancer-sink-group


a1.sources.tcp_source.type = syslogtcp
a1.sources.tcp_source.host = 172.11.111.110
a1.sources.tcp_source.port = 514

a1.sources.tcp_source.channels = file_channel
a1.sinks.flume_avro_agent1.channel = file_channel
a1.sinks.flume_avro_agent2.channel = file_channel

a1.channels.file_channel.type = file
a1.channels.file_channel.checkpointDir = /tmp/HadoopUser/checkpoint
a1.channels.file_channel.dataDirs = /tmp/HadoopUser/checkdata
a1.channels.file_channel.transcationCapacity = 5000
a1.channels.file_channel.capacity = 25000

# Define sink group for load balancing
a1.sinkgroups.load-balancer-sink-group.sinks = flume_avro_agent1 flume_avro_agent2
a1.sinkgroups.load-balancer-sink-group.processor.type = load_balance
a1.sinkgroups.load-balancer-sink-group.processor.selector = ROUND_ROBIN

# avro-sink-1 properties
a1.sinks.flume_avro_agent1.type = AVRO
a1.sinks.flume_avro_agent1.hostname = 172.11.111.111
a1.sinks.flume_avro_agent1.port = 6646

# avro-sink-2 properties
a1.sinks.flume_avro_agent2.type = AVRO
a1.sinks.flume_avro_agent2.hostname = 172.11.111.112
a1.sinks.flume_avro_agent2.port = 6646

Error:
2015-09-11 11:08:55,427 (lifecycleSupervisor-1-4) [ERROR - org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:253)] Unable to start EventDrivenSourceRunner: { source:org.apache.flume.source.SyslogTcpSource{name:tcp_source,state:IDLE} } - Exception follows.
org.jboss.netty.channel.ChannelException: Failed to bind to: /172.11.111.110:514
    at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)
    at org.apache.flume.source.SyslogTcpSource.start(SyslogTcpSource.java:124)
    at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44)
    at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.BindException: Cannot assign requested address
    at sun.nio.ch.Net.bind0(Native Method)
    at sun.nio.ch.Net.bind(Net.java:444)
    at sun.nio.ch.Net.bind(Net.java:436)
    at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
    at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
    at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)
    at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)
    at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)
    at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)
    ... 3 more