DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker
arXiv:1701.01724 · doi:10.1126/science.aam6960
Abstract
Artificial intelligence has seen several breakthroughs in recent years, with games often serving as milestones. A common feature of these games is that players have perfect information. Poker is the quintessential game of imperfect information, and a longstanding challenge problem in artificial intelligence. We introduce DeepStack, an algorithm for imperfect information settings. It combines recursive reasoning to handle information asymmetry, decomposition to focus computation on the relevant decision, and a form of intuition that is automatically learned from self-play using deep learning. In a study involving 44,000 hands of poker, DeepStack defeated with statistical significance professional poker players in heads-up no-limit Texas hold'em. The approach is theoretically sound and is shown to produce more difficult to exploit strategies than prior approaches.
References in corpus (3)
Cited by in corpus (7)
- DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker
- Understanding and Comparing Deep Neural Networks for Age and Gender Classification
- Finding Friend and Foe in Multi-Agent Games
- Monte Carlo Neural Fictitious Self-Play: Approach to Approximate Nash equilibrium of Imperfect-Information Games
- Problems with the EFG formalism: a solution attempt using observations
- Low-Variance and Zero-Variance Baselines for Extensive-Form Games
- VRGym: A Virtual Testbed for Physical and Interactive AI