Should Kafka Streams be used as/instead of an integration framework (ESB)?

[Baden]

I will be using Kafka Connect + Streams in an upcoming project where I also want to have an ESB. In reviewing some integration frameworks (Apache Camel / Mule / Apache ServiceMix) I am trying to consider if having this microservices architecture should simply be used in place of an actual ESB (https://www.voxxed.com/blog/2015/01/good-microservices-architectures-death-enterprise-service-bus-part-one/).

Just as with an ESB implementation, I would want all comm's to be maintained through this layer - but is it needed for user-based pipelines such as updating user-based projects/properties from a web UI (using ElasticSearch so a direct connection through NEST). An automation component will be responsible for fetching data as a consumer through Kafka Connect then to ES. Again, is there a need to put this through an ESB type interface?

Can someone please shed some light on this topic for me?

[gay...@contentsphere.com]

Hi Baden

I am trying to something similar. Any luck with your initiative ? Were you able to integrate Camel into the Kafka Stream/Connect eco system ?

-Gayatri

[Baden d.]

Hi Gayatri,

Maybe we can collaborate on this and help each other out.  Have you created a POC yet?

--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/v2yRh8p99g4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/6850f91f-0fac-464c-8663-fbd87451c57f%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[gay...@contentsphere.com]

Not yet created the POC. But looks like Camel will be a redundant mechanism in the Kafka/Streams eco system. What do you think, will it add any value in this integration?

-Gayatri 

On Thursday, May 25, 2017 at 7:42:18 PM UTC+5:30, Baden wrote:

Hi Gayatri,

Maybe we can collaborate on this and help each other out.  Have you created a POC yet?

On Thu, May 25, 2017 at 9:48 AM, <gay...@contentsphere.com> wrote:

Hi Baden

I am trying to something similar. Any luck with your initiative ? Were you able to integrate Camel into the Kafka Stream/Connect eco system ?

-Gayatri

--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/v2yRh8p99g4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.