Fwd: Regarding Kafka Connect Hbase Sink connector contribution

[Nishu]

Dear team,

Happy New Year! 

Hope you are doing good.

I am working on Confluent platform in my current assignment. Its an amazing product with all functionalities at one place. 

I would like to bring to your knowledge about Kafka Connect connectors, I got a chance to use HBase Sink connector listed in Confluent Connectors page for copy JSON data to HBase.

http://docs.datamountaineer.com/en/latest/hbase.html 

https://github.com/mravi/kafka-connect-hbase

Those are great connectors, but found few limitations, I came across. 

1. Stream reactor HBase Sink connector doesn't support JSON data format as of now.

2. mravi's hbase sink connector, is developed on Kafka 0.9. New Kafka version 1.0.0 has some updates on the Connector APIs, so it doesn't compile with the Kafka 1.0

3. It doesn't support writing data to multiple column families.

3. It doesn't have support for Kafka payload field selection.

And I think, many other people might have also faced the same challenge to make that work. 

I have forked the Repo, and enhanced the connector with above features. Already made a pull request to mravi though to merge. I am not sure if that connector is actively maintained. Hence I thought of contributing the connector to confluent connectors list so that it can be helpful for others. 

Here is the connector available : https://github.com/nishutayal/kafka-connect-hbase 

Please review and let me know if it meets the criteria. 

Looking forward to your response :)

-- 

Thanks & Regards,

Nishu Tayal

[Nishu]

Dear team,

I had been looking on kafka-hbase-connector. so got a chance to use HBase Sink connector listed in Confluent Connectors page for copy JSON data to HBase.

http://docs.datamountaineer.com/en/latest/hbase.html 

https://github.com/mravi/kafka-connect-hbase

Those are great connectors, but found few limitations, I came across. 

1. Stream reactor HBase Sink connector doesn't support JSON data format as of now.

2. mravi's hbase sink connector, is developed on Kafka 0.9. New Kafka version 1.0.0 has some updates on the Connector APIs, so it doesn't compile with the Kafka 1.0

3. It doesn't support writing data to multiple column families.

3. It doesn't have support for Kafka payload field selection.

And I think, many other people might have also faced the same challenge to make that work. 

I have forked the Repo, and enhanced the connector with above features. I had made a pull request to mravi though to merge 6 months ago but it seems, it is not maintained anymore.  

Hence I thought if it is possible I can maintain the connectore and contribute to your list so that it can be helpful for others. 

Here is the connector available : https://github.com/nishutayal/kafka-connect-hbase 

Please review and let me know if it meets the criteria.  

Looking forward to your response :)

--