NoSuchMethod error in flume with kafka

37 views
Skip to first unread message

周元元

unread,
Aug 21, 2014, 2:25:15 AM8/21/14
to hado...@googlegroups.com

kafka version is 0.7.2,flume version is 1.5.0, flume + kafka plugin: https://github.com/baniuyao/flume-kafka

error info:

2014-08-20 18:55:51,755 (conf-file-poller-0) [ERROR -org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:149)] Unhandled error java.lang.NoSuchMethodError: scala.math.LowPriorityOrderingImplicits.ordered()Lscala/math/Ordering; at kafka.producer.ZKBrokerPartitionInfo$$anonfun$kafka$producer$ZKBrokerPartitionInfo$$getZKTopicPartitionInfo$1.apply(ZKBrokerPartitionInfo.scala:172)

flume configuration:

agent_log.sources = r1
agent_log.sinks = kafka
agent_log.channels = c1

agent_log.sources.r1.type = exec
agent_log.sources.r1.channels = c1
agent_log.sources.r1.command = tail -f /var/log/test.log

agent_log.channels.c1.type = memory
agent_log.channels.c1.capacity = 1000
agent_log.channels.c1.trasactionCapacity = 100

agent_log.sinks.kafka.type = com.vipshop.flume.sink.kafka.KafkaSink
agent_log.sinks.kafka.channel = c1
agent_log.sinks.kafka.zk.connect = XXXX:2181

agent_log.sinks.kafka.topic = my-replicated-topic
agent_log.sinks.kafka.batchsize = 200
agent_log.sinks.kafka.producer.type = async
agent_log.sinks.kafka.serializer.class = kafka.serializer.StringEncoder


scala jar in the flume lib directory:

lib/scala-compiler-2.9.2.jar

lib/scala-library-2.8.0.jar

lib/scala-library-2.9.2.jar


哪位能帮忙看下这个问题?谢谢


周元元

unread,
Aug 26, 2014, 2:25:08 AM8/26/14
to hado...@googlegroups.com
问题是自己造成的,两个scala的lib库可能造成冲突了,删除一个就好了!

在 2014年8月21日星期四UTC+8下午2时25分15秒,周元元写道:
Reply all
Reply to author
Forward
0 new messages