Monte Carlo Tree Search for Simultaneous Move Games: A Case Study in the Game of Tron

Marc Lanctot, Christopher Wittlinger, Mark H.M. Winands, Niek G.P. Den Teuling

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

Abstract

MCTS has been successfully applied to many sequential games. This paper investigates Monte Carlo Tree Search (MCTS) for the simultaneous move game Tron. In this paper we describe two different ways to model the simultaneous move game, as a standard sequential game and as a stacked matrix game. Several variants are presented to adapt MCTS to simultaneous move games, such as Sequential UCT, Decoupled UCT, Exp3, and a novel stochastic method based on Regret Matching. Through the experiments in the game of Tron on four different boards, it is shown that Decoupled UCB1-Tuned perform best, winning 62.3% of games overall. We also show that Regret Matching wins 53.1% of games overall and search techniques that model the game sequentially win 51.4-54.3% of games overall.

Original languageEnglish
Title of host publicationProceedings of the Twenty-Fifth Benelux Conference on Artificial Intelligence (BNAIC 2013)
Pages104-111
Number of pages8
Publication statusPublished - 2013

Fingerprint

Dive into the research topics of 'Monte Carlo Tree Search for Simultaneous Move Games: A Case Study in the Game of Tron'. Together they form a unique fingerprint.

Cite this