Test crashed due to InterruptedException

[Yuji Ito]

Hi,

I'm testing Scalar DB with Jepsen.

https://github.com/scalar-labs/scalar-jepsen

I got the following WARN message and a test failed. But I don't know why the test failed.

Some reconnections to the DB(Cassandra) cluster repeatedly reported errors.

And, I investigated logs and wonder why Tea-Time was interrupted in the test.

A client worker or another worker was just timed out due to repeated reconnection?

- WARN message

2019-07-02 15:18:01,208{GMT} WARN [main] jepsen.core: Test crashed!

java.lang.InterruptedException: null

at java.util.concurrent.CyclicBarrier.dowait(CyclicBarrier.java:211) ~[na:1.8.0_212]

at java.util.concurrent.CyclicBarrier.await(CyclicBarrier.java:362) ~[na:1.8.0_212]

at jepsen.generator.Synchronize.op(generator.clj:718) ~[jepsen-0.1.13.jar:na]

at jepsen.generator.Concat.op(generator.clj:660) ~[jepsen-0.1.13.jar:na]

at jepsen.generator$op_and_validate.invokeStatic(generator.clj:34) ~[jepsen-0.1.13.jar:na]

at jepsen.generator$op_and_validate.invoke(generator.clj:30) ~[jepsen-0.1.13.jar:na]

at jepsen.core.ClientWorker.run_worker_BANG_(core.clj:305) ~[jepsen-0.1.13.jar:na]

at jepsen.core$run_workers_BANG_$run__5639.invoke(core.clj:187) ~[jepsen-0.1.13.jar:na]

at dom_top.core$real_pmap$build_thread__214$fn__215.invoke(core.clj:166) ~[jepsen-0.1.13.jar:na]

at clojure.lang.AFn.applyToHelper(AFn.java:152) ~[clojure-1.10.0.jar:na]

at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.10.0.jar:na]

at clojure.core$apply.invokeStatic(core.clj:665) ~[clojure-1.10.0.jar:na]

at clojure.core$with_bindings_STAR_.invokeStatic(core.clj:1973) ~[clojure-1.10.0.jar:na]

at clojure.core$with_bindings_STAR_.doInvoke(core.clj:1973) ~[clojure-1.10.0.jar:na]

at clojure.lang.RestFn.invoke(RestFn.java:425) ~[clojure-1.10.0.jar:na]

at clojure.lang.AFn.applyToHelper(AFn.java:156) ~[clojure-1.10.0.jar:na]

at clojure.lang.RestFn.applyTo(RestFn.java:132) ~[clojure-1.10.0.jar:na]

at clojure.core$apply.invokeStatic(core.clj:669) ~[clojure-1.10.0.jar:na]

at clojure.core$bound_fn_STAR_$fn__5734.doInvoke(core.clj:2003) ~[clojure-1.10.0.jar:na]

at clojure.lang.RestFn.invoke(RestFn.java:397) ~[clojure-1.10.0.jar:na]

at clojure.lang.AFn.run(AFn.java:22) ~[clojure-1.10.0.jar:na]

at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_212]

- Reconnection error

2019-07-02 15:18:00,070{GMT} ERROR [cluster67-reconnection-0] com.datastax.driver.core.ControlConnection: [Control connection] Cannot connect to any host, scheduling retry in 4000 milliseconds

- Tea-Time WARN

2019-07-02 15:17:46,572{GMT} WARN [Tea-Time 1] tea-time.core: Tea-Time task #tea_time.core.Once{:id 76, :f #object[jepsen.generator.TimeLimit$fn__3400 0x51bdfafb jepsen.generator.TimeLimit$fn__3400@51bdfafb], :t 481666428234, :cancelled #object[clojure.lang.Atom 0x7e617636 {:status :ready, :val false}]} threw

java.lang.InterruptedException: sleep interrupted

at java.lang.Thread.sleep(Native Method) [na:1.8.0_212]

at jepsen.generator.TimeLimit$fn__3400.invoke(generator.clj:534) ~[jepsen-0.1.13.jar:na]

at tea_time.core.Once.run(core.clj:181) ~[jepsen-0.1.13.jar:na]

at tea_time.core$run_tasks_BANG_$fn__3169$fn__3170.invoke(core.clj:261) ~[jepsen-0.1.13.jar:na]

at tea_time.core$run_tasks_BANG_$fn__3169.invoke(core.clj:260) [jepsen-0.1.13.jar:na]

at tea_time.core$run_tasks_BANG_.invokeStatic(core.clj:250) [jepsen-0.1.13.jar:na]

at tea_time.core$run_tasks_BANG_.invoke(core.clj:245) [jepsen-0.1.13.jar:na]

at tea_time.core$start_BANG_$fn__3189$fn__3190.invoke(core.clj:311) [jepsen-0.1.13.jar:na]

at clojure.lang.AFn.applyToHelper(AFn.java:152) [clojure-1.10.0.jar:na]

at clojure.lang.AFn.applyTo(AFn.java:144) [clojure-1.10.0.jar:na]

at clojure.core$apply.invokeStatic(core.clj:665) [clojure-1.10.0.jar:na]

at clojure.core$with_bindings_STAR_.invokeStatic(core.clj:1973) [clojure-1.10.0.jar:na]

at clojure.core$with_bindings_STAR_.doInvoke(core.clj:1973) [clojure-1.10.0.jar:na]

at clojure.lang.RestFn.invoke(RestFn.java:425) [clojure-1.10.0.jar:na]

at clojure.lang.AFn.applyToHelper(AFn.java:156) [clojure-1.10.0.jar:na]

at clojure.lang.RestFn.applyTo(RestFn.java:132) [clojure-1.10.0.jar:na]

at clojure.core$apply.invokeStatic(core.clj:669) [clojure-1.10.0.jar:na]

at clojure.core$bound_fn_STAR_$fn__5734.doInvoke(core.clj:2003) [clojure-1.10.0.jar:na]

at clojure.lang.RestFn.invoke(RestFn.java:397) [clojure-1.10.0.jar:na]

at clojure.lang.AFn.run(AFn.java:22) [clojure-1.10.0.jar:na]

at java.lang.Thread.run(Thread.java:748) [na:1.8.0_212]

Thanks,

Yuji