ACPC 2016: Results Amendment

[Kevin Waugh]

Hello all,

Regretfully, I must inform you that the results announced at AAAI 2016 workshop were erroneous.  In particular, the additional matches that were run to separate the top four agents, seeds 100 and higher, were biased as all these matches used the same sequence of cards.  We gratefully thank the member of the community who brought this to our attention.

Operationally, this occurred because I generated 64-bit chance seeds for these matches when 32-bit seeds were expected by the dealer.  An error message has been introduced to prevent this from happening in the future.

This introduced bias invalidates the previously posted results for the Bankroll Instant Runoff competition, where in a sense it resulted in an effective sample size of two between the top agents.

To correct this error, additional matches between the top four, and subsequently the top two agents, were run.  The log files, crosstable and ordering have been corrected on the competition website; and an errata has been added to the top of the results page.

The Bankroll Instant Runoff winners are:

1) Baby Tartanian8 (Noam Brown and Tuomas Sandholm, CMU)

2) Slumbot (Eric Jackson, Independent)

3) Act1 (Tim Reiff, Independent)

Note, this ordering is statistically significant.

My sincerest apologies to all you,

 - Kevin