Storing Streaming Data in Apache Paimon via Flink SQL

[Arjun Sivakumar]

Hi team,

Is it possible to store streaming data in Apache Paimon using Flink SQL in Nussknacker ? If not, can a custom plugin be developed to enable this functionality in Nussknacker? Additionally, is there any roadmap or plan to support this feature in the future?
Any suggestions or recommendations are welcome.

Thanks in Advance,
Arjun S

[Mateusz Słabek]

Hi Arjun,

Apache Paimon components are available as part of the Nussknacker Enterprise offering. You can contact Nussknacker Enterprise at enter...@nussknacker.io.

If you're interested, you can configure integration with Apache Iceberg through AWS Glue in Nussknacker Cloud. You can read more about it here https://nussknacker.io/blog/building-iceberg-lakehouse-with-aws-glue. Our Apache Paimon Enterprise components are similar to Iceberg components used in the blog post.

Thanks,
Mateusz