Modelling collective motion based on the principle of agency

Abstract

Collective motion is an intriguing phenomenon, especially considering that it arises from a set of simple rules governing local interactions between individuals. In theoretical models, these rules are normally \emph{assumed} to take a particular form, possibly constrained by heuristic arguments. We propose a new class of models, which describe the individuals as \emph{agents}, capable of deciding for themselves how to act and learning from their experiences. The local interaction rules do not need to be postulated in this model, since they \emph{emerge} from the learning process. We apply this ansatz to a concrete scenario involving marching locusts, in order to model the phenomenon of density-dependent alignment. We show that our learning agent-based model can account for a Fokker-Planck equation that describes the collective motion and, most notably, that the agents can learn the appropriate local interactions, requiring no strong previous assumptions on their form. These results suggest that learning agent-based models are a powerful tool for studying a broader class of problems involving collective motion and animal agency in general.

13 pages plus 6 page appendix, 6 figures

References in corpus (7)

• Novel type of phase transition in a system of self-driven particles
• Collective Motion due to escape and pursuit response
• A model for rolling swarms of locusts
• Projective simulation with generalization
• Asynchrony promotes polarized collective motion in attraction based models
• Robotic Playing for Hierarchical Complex Skill Learning
• Mean Field Model for Collective Motion Bistability

Cited by in corpus (11)

• Photonic architecture for reinforcement learning
• Collective defense of honeybee colonies: experimental results and theoretical modeling
• Operationally meaningful representations of physical systems in neural networks
• Benchmarking projective simulation in navigation problems
• Development of swarm behavior in artificial learning agents that adapt to different foraging environments
• Random motion of a circle microswimmer in a random environment
• Reinforcement Learning of Artificial Microswimmers
• Development of collective behavior in newborn artificial agents
• Hybrid discrete-continuous compilation of trapped-ion quantum circuits with deep reinforcement learning
• Machine learning and behavioral economics for personalized choice architecture
• Counting Risk Increments to Make Decisions During an Epidemic