Testing functions that aren’t idempotent.

15 views
Skip to first unread message

Jens Troeger

unread,
Dec 30, 2022, 1:33:16 AM12/30/22
to Hypothesis users
Hello,

Following up on this somewhat dated question: What does Flaky: Hypothesis test produces unreliable results mean?

If the function under test isn’t idempotent, then should I consider the repeat-failure as a passing test scenario? What is the recommended approach here?

It also looks like Hypothesis always replays a test even if I supply only one single example using st.just()? Is it documented somewhere in more detail how Hypothesis explores and replays tests? (I’m still reading my way through all of the docs and articles…)

Much thanks,
Jens
Reply all
Reply to author
Forward
0 new messages