Grouping Nodes for Monte-Carlo Tree Search

Jahn Takeshi Saito, Mark H M Winands, Jos W H M Uiterwijk, H. Jaap Van Den Herik

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

Abstract

Only recently Monte-Carlo Tree Search (MCTS) has substantially contributed to the field of computer Go. So far, in standard MCTS there is only one type of node: every node of the tree represents a single move. Instead of maintaining only this type of node, we propose a second type of node representing groups of moves. Thus, the tree may contain move nodes and group nodes. This article documents how such group nodes can be utilised for including domain knowledge in MCTS. Furthermore, we present a technique, called Alternating-Layer UCT, for managing move nodes and group nodes in a tree with alternating layers of move nodes and group nodes. A self-play experiment performed in the game of Go demonstrates that group nodes can be used effectively to integrate domain knowledge in a MCTS program and thereby improve its playing strength.
Original languageEnglish
Title of host publication19th Belgian-Dutch Conference on Artificial Intelligence
Pages276-283
Number of pages8
Publication statusPublished - 2007

Cite this

Saito, J. T., Winands, M. H. M., Uiterwijk, J. W. H. M., & Van Den Herik, H. J. (2007). Grouping Nodes for Monte-Carlo Tree Search. In 19th Belgian-Dutch Conference on Artificial Intelligence (pp. 276-283) http://www.mendeley.com/research/grouping-nodes-montecarlo-tree-search