Hunting active Brownian particles: Learning optimal behavior
arXiv:2111.10826 · doi:10.1103/PhysRevE.104.054614
Abstract
We numerically study active Brownian particles that can respond to environmental cues through a small set of actions (switching their motility and turning left or right with respect to some direction) which are motivated by recent experiments with colloidal self-propelled Janus particles. We employ reinforcement learning to find optimal mappings between the state of particles and these actions. Specifically, we first consider a predator-prey situation in which prey particles try to avoid a predator. Using as reward the squared distance from the predator, we discuss the merits of three state-action sets and show that turning away from the predator is the most successful strategy. We then remove the predator and employ as collective reward the local concentration of signaling molecules exuded by all particles and show that aligning with the concentration gradient leads to chemotactic collapse into a single cluster. Our results illustrate a promising route to obtain local interaction rules and design collective states in active matter.
to appear in Phys. Rev. E
References in corpus (11)
- Self-motile colloidal particles: from directed propulsion to random walk
- Physics of Microswimmers - Single Particle Motion and Collective Behavior
- Phototaxis of synthetic microswimmers in optical landscapes
- Gravitaxis of asymmetric self-propelled colloidal particles
- Dynamic clustering and chemotactic collapse of self-phoretic active particles
- Microswimmers learning chemotaxis with genetic algorithms
- Learning to Control Active Matter
- Active-Particle Polarization Without Alignment Forces
- Quorum-sensing active particles with discontinuous motility
- A single predator charging a herd of prey: effects of self volume and predator-prey decision-making
- Numerical analysis of homogeneous and inhomogeneous intermittent search strategies