Stability and Diversity in Collective Adaptation
arXiv:nlin/0408039 · doi:10.1016/j.physd.2005.06.031
Abstract
We derive a class of macroscopic differential equations that describe collective adaptation, starting from a discrete-time stochastic microscopic model. The behavior of each agent is a dynamic balance between adaptation that locally achieves the best action and memory loss that leads to randomized behavior. We show that, although individual agents interact with their environment and other agents in a purely self-interested way, macroscopic behavior can be interpreted as game dynamics. Application to several familiar, explicit game interactions shows that the adaptation dynamics exhibits a diversity of collective behaviors. The simplicity of the assumptions underlying the macroscopic equations suggests that these behaviors should be expected broadly in collective adaptation. We also analyze the adaptation dynamics from an information-theoretic viewpoint and discuss self-organization induced by information flux between agents, giving a novel view of collective adaptation.
22 pages, 23 figures; updated references, corrected typos, changed content
References in corpus (1)
Cited by in corpus (26)
- Life is physics: evolution as a collective phenomenon far from equilibrium
- Scattering matrix approach to the description of quantum electron transport
- Dynamics of Boltzmann Q-Learning in Two-Player Two-Action Games
- The prevalence of chaotic dynamics in games with many players
- Cooperation, Norms, and Revolutions: A Unified Game-Theoretical Approach
- Deterministic limit of temporal difference reinforcement learning for stochastic games
- Escort Evolutionary Game Theory
- Cyclic game dynamics driven by iterated reasoning
- Cycles of cooperation and defection in imperfect learning
- Information Anatomy of Stochastic Equilibria
- Deciphering chaos in evolutionary games
- Learning enables adaptation in cooperation for multi-player stochastic games
- Learning to play public good games
- Unlearnable Games and "Satisficing'' Decisions: A Simple Model for a Complex World
- Stationary Stability for Evolutionary Dynamics in Finite Populations
- Fixation and escape times in stochastic game learning
- Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics
- Selfish optimization and collective learning in populations
- Follow-the-Regularized-Leader Routes to Chaos in Routing Games
- The Replicator Dynamics of Zero-Sum Games Arise from a Novel Poisson Algebra
- Stochastic evolution in populations of ideas
- Complex behaviour in cyclic competition bimatrix games
- Unstable Dynamics of Adaptation in Unknown Environment due to Novelty Seeking
- Momentum Accelerates Evolutionary Dynamics
- On the use of chaotic dynamics for mobile network design and analysis: towards a trace data generator
- Catastrophe by Design in Population Games: Destabilizing Wasteful Locked-in Technologies