Go, AI and Game Theory [feedly]
John Case
http://www.digitopoly.org/2016/03/12/go-ai-and-game-theory/
I haven’t played Go but have been reading about it over the last little while since it turned out that an AI learned to beat the world champion in it. The significance of this is that those who knew the game of Go believed that it was out of a machine’s reach to learn to play it better than the best human. This is because, unlike chess, brute computational force was not a competitive advantage. Go is too complex and, thus, there is an art to playing it.
Even though I don’t know much about the game, it is interesting to read accounts of how DeepMind’s AlphaGo was able to defeat Lee Sedol.
At first, Fan Hui thought the move was rather odd. But then he saw its beauty.
“It’s not a human move. I’ve never seen a human play this move,” he says. “So beautiful.” It’s a word he keeps repeating. Beautiful. Beautiful. Beautiful.
There were no complaints about the unfair computational ability here. Instead, an appreciation of something new — in my reading, a new strategy. In other words, an innovation.
How did the innovation arise? For it to be one, no human knew of it beforehand including those ‘programming’ (if that is the right word now), AlphaGo. This seems to be the case. Instead, AlphaGo learned to play it by being fed the data for thousands of games including those presumably played by Lee Sedol. Interestingly, this is a similar approach to how top Go players are trained. But AlphaGo was also learning as it played Fan Hui, the European champ it defeated a few months ago. Interesting Fan Hui was learning too and through their interaction his game has dramatically improved from 633 to being in the 300s. In other words, AlphaGo had the corpus of knowledge of past Go games and their players but was being trained by someone who was far from the best. It was not like it was the number 2 player in the world or a Top 10 player.
This achievement is monumental but the game theorist in my is still unsure if that is it for human Go players. There are things we don’t know. For instance, AlphaGo may have trained to play one person, Lee Sedol, and may well lose to others. Fan Hui has defeated Go in unofficial games. In particular, how would AlphaGo go against people who made more mistakes? My point here is that AlphaGo may have been trained to know who it is playing but what happens when it doesn’t know that. Game theory tells us that your tactics will change depending upon who you play against (just think about the scissor’s biased people in Rock-Paper-Scissors). A human Go champion knows what they are up against but what as AlphaGo know. My assumption here is that it may have known too much. (By the way, this is perhaps the reason why the best chess players in the world combine a team of humans with an AI rather than an AI alone).
This suggests some other implications. First, it would be interesting to test AlphaGo playing when it did not know the identity of the player or where the players may switch while the same AI entity is playing. Second, AlphaGo is a new serious player but this does not necessarily imply that it or its descendants cannot be defeated. Instead, there is a new set of learning that needs to occur. AlphaGo has innovated but we do not know if that innovation can only be carried out by an AI or if it can be imitated and understood by human players. Third, because Go is so complex, that means that learning from it involves a different stock of knowledge and set of experiences for each AI that attempts it. That means AI’s will play each other. Apparently, AlphaGo learned this way but was it playing itself or a different AI that had learned to play the game independently? The difference may matter.
Finally, and this is an important one. AlphaGo got where it did because it stood on the shoulders of human giants. In other situations, it has learned from scratch and played other computers (as in DeepMind’s mastery of Space Invaders). Thus, at the moment, AI is not able to learn something like this independent of 2,500 years of knowledge accumulated by humans. It will be a different matter of an AI can learn independently and defeat humans without ever seeing a human play.
This story isn’t over yet.
-- via my feedly newsfeed