Hi everyone,
Following some recent discussions in GitHub Issues[1], I wanted to open a broader conversation about the future of the MultiTenantFilter and our wider plans for tenant isolation within the project.
The MultiTenantFilter was one of our first filters and has served as a valuable proof-of-concept for tenant isolation. While it remains marked as "incubation/preview" and carries known limitations, including incomplete RPC coverage and no solution to Noisy Neighbour issues, users have picked it up and are using it in Production. I think we should support these users and give them clarity about the future of the topics that have manifested on their Kafka cluster.
I'm currently wondering about two directions: continuing to extend the existing filter versus shifting focus to the newer, code-generated EntityIsolationFilter[2].
A proposed strategy is:
Continued Support: We will continue to accept essential, low-risk enhancements (like the custom prefix PR) to ensure the MultiTenantFilter remains viable for existing workflows.
Explicit Migration Goals: We add requirements to the EntityIsolationFilter design to ensure it can support the naming patterns established by the MultiTenantFilter.
The End-Goal: We want to reach feature parity, at which point we will provide a defined migration path to help users transition from the MultiTenantFilter to the EntityIsolationFilter without disruption to existing Kafka topics. We would deprecate MultiTenantFilter for deletion at this point.