A note about the Evaluator and sending DA diagnoses and recovery commands

[Scott Poll]

Please note that the Evaluator stores all DA recovery commands that
are issued during the scenario and sends them in bulk to the Oracle
after parsing the entire scenario. Therefore, it is better for DAs to
wait until near the end of the scenario to issue the recovery commands
that correspond to the state of the system after 3 minutes, 30 seconds
(no faults will be injected after this time). The scenario terminates
after 4 minutes.

However, this is not true for diagnoses. Since the metrics from DXC09
will be used in tie-break situations, it is better send diagnoses
suggested by the observations during the scenario. For example, send a
diagnosis after each fault injection. This will insure that you don't
have an excessively long detection and isolation times. Also, we
intend to use the DXC09 metrics for additional research and kindly
request that diagnoses are submitted as the evidence allows for both
DP1 and DP2.

In summary, for DA diagnoses, send early, send often; for DA recovery
commands, hold off until near the end of the scenario and send once.