Speed Test

[gome...@gmail.com]

Hi, would it be possible to add some timing information for the AI v AI matches?

How long does a MCTS STR=4 mirror match take (let's say using some arbitrary deck)?

How about MMAB?

For example, I tested Forge, and found that a typical match takes ~1-5 seconds for AI v AI (with various decks). Personally, I think this is too slow, but trying to optimize Forge is actually really hard, because the AI code and game logic are tightly-interwoven. I'm hoping that MagArena having more cleanly separated AI code will mean it's easier to optimize. Thoughts?

[Melvin Zhang]

In MagArena, the AI level is the number of seconds it has to think for each move. Therefore, MCTS STR=4, means MCTS takes at most 4s per move.

Currently only integer value is supported for strength, so the minimum thinking time is 1s. It does make sense to support fractional values like 0.5s, contributions are welcome at our github project at https://github.com/magarena/magarena

From our internal testing, MCTS doesn't perform well unless it has sufficient simulations to get decent statistics, and currently that takes a few seconds (see 

https://github.com/magarena/magarena/wiki/AIComparison). Reducing the time taken to obtain simulations can improve its playing strength substantially.

Project Firemind uses MagArena to run AI vs AI matches, you can see how long it takes on the duels page. For example, at https://www.firemind.ch/duels/623965

Regards,

Melvin

--
You received this message because you are subscribed to the Google Groups "Magarena" group.
To unsubscribe from this group and stop receiving emails from it, send an email to magarena+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.