[L.e.e.l.a] AlphaZero vs Stockfish 8 Scaling Recreation Completed!

[Cscuile]

This project took far longer than I initially thought it would take. 

After much work and effort, I present to you The AlphaZero-Stockfish 8 Scaling Recreation! 

Link to Docs: https://docs.google.com/spreadsheets/d/1ZAIuHR6n-5JTxKQc0XUSx1jyUrgVEcj8DNLKA7-urBw/edit#gid=1057148787

(Technical Details Below)

Leela ID 11248 vs. Stockfish 10 Dev (August 18, 2018)

Technical Details:

-An 875:1 ratio is ALWAYS maintained. 

-These tests used Leela ID 11248 and Stockfish 10 Dev [August 18].

-Stockfish Dev Scaling is used for Stockfish's relative Elo. 

-0.1 Seconds or 0 Elo is set to 848 vs 741,825 nodes.

-NO Book or Tablebase is used. 
-NO Adjudication, Engines must play until mate. 

If you have any further questions, please feel free to ask me below or on discord at Cscuile#0044. 

Thank you! 

[Cscuile]

Here is a smaller version of the Scaling Charts. Enjoy!

[Dietrich Kappe]

That’s a lot of work and patience. Thanks.

[Cscuile]

+Dietrich 

My pleasure. =D

[Jon Mike]

Thank you so much for sharing this!  :)

I noticed at the 875:1 ratio, around 3.8-4.2 seconds per move (on test hardware) or around 60K nodes for lc0 and 50 million nodes for SF, lc0 is optimized to the closest strength of SF, only around 15 elo points difference.

Cscuile, you are a great asset to this community!  

P.S: When you get the time could you share the games of lc0 (11248) vs SF here or on the download list thread?




On Thursday, October 18, 2018 at 5:48:56 PM UTC-5, Cscuile wrote:

...

[Cscuile]

Interesting. Perhaps there is a nodes ratio between 14k and 80k in which Leela is -10 Elo to SF. 

And thank you Jon! Glad to see that people are finding my tests! 

Sure, the file is too large to upload directly to groups. But here is a link to Google Drive for the PGN files. 
https://drive.google.com/file/d/1DaQOrlSECyLuSrZ1n6nNHSiuk9ypmK6b/view?usp=sharing