TransZero: Parallel Tree Expansion in MuZero using Transformer Networks

Emil Malmsten, Wendelin Böhmer

We present TransZero, a model-based reinforcement learning algorithm that removes the sequential bottleneck in Monte Carlo Tree Search (MCTS). Unlike MuZero, which constructs its s…