Predicting Human Behavior in Unrepeated, Simultaneous-Move Games

Abstract

It is common to assume that agents will adopt Nash equilibrium strategies; however, experimental studies have demonstrated that Nash equilibrium is often a poor description of human players' behavior in unrepeated normal-form games. In this paper, we analyze five widely studied models (Quantal Response Equilibrium, Level-k, Cognitive Hierarchy, QLk, and Noisy Introspection) that aim to describe actual, rather than idealized, human behavior in such games. We performed what we believe is the most comprehensive meta-analysis of these models, leveraging ten different data sets from the literature recording human play of two-player games. We began by evaluating the models' generalization or predictive performance, asking how well a model fits unseen test data after having had its parameters calibrated based on separate training data. Surprisingly, we found that what we dub the QLk model of Stahl & Wilson (1994) consistently achieved the best performance. Motivated by this finding, we describe methods for analyzing the posterior distributions over a model's parameters. We found that QLk's parameters were being set to values that were not consistent with their intended economic interpretations. We thus explored variations of QLk, ultimately identifying a new model family that has fewer parameters, gives rise to more parsimonious parameter values, and achieves better predictive performance.

References in corpus (5)

• Graphical Models for Game Theory
• Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (2001)
• A Model of Human Cooperation in Social Dilemmas
• Cyclic game dynamics driven by iterated reasoning
• Learning Game Representations from Data Using Rationality Constraints

Cited by in corpus (6)

• The Hanabi Challenge: A New Frontier for AI Research
• Computational Models of Human Decision-Making with Application to the Internet of Everything
• Arena: A General Evaluation Platform and Building Toolkit for Multi-Agent Intelligence
• Anytime Game-Theoretic Planning with Active Reasoning About Humans' Latent States for Human-Centered Robots
• Bounded Risk-Sensitive Markov Games: Forward Policy Design and Inverse Reward Learning with Iterative Reasoning and Cumulative Prospect Theory
• Models of Level-0 Behavior for Predicting Human Behavior in Games