Effects of noise on convergent game learning dynamics
arXiv:1109.4853 · doi:10.1088/1751-8113/45/10/105001
Abstract
We study stochastic effects on the lagging anchor dynamics, a reinforcement learning algorithm used to learn successful strategies in iterated games, which is known to converge to Nash points in the absence of noise. The dynamics is stochastic when players only have limited information about their opponents' strategic propensities. The effects of this noise are studied analytically in the case where it is small but finite, and we show that the statistics and correlation properties of fluctuations can be computed to a high accuracy. We find that the system can exhibit quasicycles, driven by intrinsic noise. If players are asymmetric and use different parameters for their learning, a net payoff advantage can be achieved due to these stochastic oscillations around the deterministic equilibrium.
arXiv comment17 pages, 8 figures
References in corpus (7)
- Predator-prey cycles from resonant amplification of demographic stochasticity
- Coexistence versus extinction in the stochastic cyclic Lotka-Volterra model
- Coupled Replicator Equations for the Dynamics of Learning in Multiagent Systems
- Stochastic gain in population dynamics
- Evolutionary dynamics, intrinsic noise and cycles of co-operation
- Intrinsic noise in game dynamical learning
- Cycles of cooperation and defection in imperfect learning