Hdfs Connector not writing to hdfs

17 views
Skip to first unread message

SMJ

unread,
Jul 27, 2018, 3:05:12 PM7/27/18
to Confluent Platform
The connector ran and wrote files to hdfs successfully for a few minutes but seeing this error right now and it hasn't been writing to hdfs:
[INFO] 2018-07-27 09:44:18,145 io.confluent.connect.hdfs.TopicPartitionWriter recover - Finished recovery for topic partition test.promoted.msgs-64
[INFO] 2018-07-27 09:44:18,145 io.confluent.connect.hdfs.TopicPartitionWriter recover - Started recovery for topic partition test.promoted.msgs-2
[ERROR] 2018-07-27 09:44:18,372 com.mapr.fs.MapRFileSystem delete - Failed to delete path maprfs://input/sjc2/logs/test.promoted.msgs/2/log.1, error: No such file or directory (2)

This is the only error we're seeing in the logs and all the tasks are still running successfully and `maprfs://input/sjc2/logs/test.promoted.msgs` is empty for every partition. It's trying to delete log.1 and it doesn't even exist! What's the workaround for this?

Reply all
Reply to author
Forward
0 new messages