How to create Kafka failure using choas monkey

192 views
Skip to first unread message

Subbu M

unread,
Nov 4, 2024, 4:42:41 PM11/4/24
to Chaos Community
Hi,

I have a resilient system that sends messages to both the Primary and Secondary Kafka clusters. However, when I use iptables and the Hystrix library, it detects timeouts and retries for a longer period of time, causing data to become congested at the producer. Conversely, when I intentionally shut down the Kafka service during the same test, Hystrix detects the error and opens the circuit and immediately sends the messages to secondary.

Any thoughts I can use Chaos monkey to simulate real Kafka failure?

regards
Subbu

Casey Rosenthal

unread,
Nov 4, 2024, 7:44:32 PM11/4/24
to Subbu M, Chaos Community

Check out Trogdor, a fault injection tool built into Kafka: https://github.com/a0x8o/kafka/blob/master/TROGDOR.md

Thanks!
-Casey


--
You received this message because you are subscribed to the Google Groups "Chaos Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chaos-communi...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/chaos-community/86f2f456-2c5a-4d2f-bbc4-73b13fcdd3a2n%40googlegroups.com.

Johannes Edmeier

unread,
Nov 18, 2024, 4:09:56 AM11/18/24
to Chaos Community
Reply all
Reply to author
Forward
0 new messages