Learning how to find targets in the micro-world: The case of intermittent active Brownian particles

Abstract

Finding the best strategy to minimize the time needed to find a given target is a crucial task both in nature and in reaching decisive technological advances. By considering learning agents able to switch their dynamics between standard and active Brownian motion, here we focus on developing effective target-search behavioral policies for microswimmers navigating a homogeneous environment and searching for targets of unknown position. We exploit Projective Simulation, a reinforcement learning algorithm, to acquire an efficient stochastic policy represented by the probability of switching the phase, i.e. the navigation mode, in response to the type and the duration of the current phase. Our findings reveal that the target-search efficiency increases with the particle's self-propulsion during the active phase and that, while the optimal duration of the passive case decreases monotonically with the activity, the optimal duration of the active phase displays a non-monotonic behavior.

arXiv comment10 pages, 3 figures

References in corpus (32)

• Active Particles in Complex and Crowded Environments
• Self-motile colloidal particles: from directed propulsion to random walk
• Physics of Microswimmers - Single Particle Motion and Collective Behavior
• Active Motion of Janus Particle by Self-thermophoresis in Defocused Laser Beam
• Diffusion with Stochastic Resetting
• Intermittent search strategies
• How far from equilibrium is active matter?
• Diffusive transport without detailed balance in motile bacteria: Does microbiology need statistical physics?
• First order transition for the optimal search time of Lévy flights with resetting
• Optimal search strategies for hidden targets
• The statistical physics of active matter: from self-catalytic colloids to living cells
• Flow Navigation by Smart Microswimmers via Reinforcement Learning
• Bidimensional intermittent search processes: an alternative to Levy flights strategies
• Zermelo's problem: Optimal point-to-point navigation in 2D turbulent flows using Reinforcement Learning
• Robustness of optimal intermittent search strategies in dimension 1, 2 and 3
• The topography of the environment alters the optimal search strategy for active particles
• Run-and-tumble particles in two-dimensions : Marginal position distributions
• Machine learning strategies for path-planning microswimmers in turbulent flows
• Optimal steering of a smart active particle
• Finding Efficient Swimming Strategies in a Three Dimensional Chaotic Flow by Reinforcement Learning
• Active Brownian Motion in two-dimensions under Stochastic Resetting
• Self-learning how to swim at low Reynolds number
• Microswimmers learning chemotaxis with genetic algorithms
• Analytic Solution of an Active Brownian Particle in a Harmonic Well
• Smart Inertial Particles
• Projective simulation for classical learning agents: a comprehensive investigation
• Optimal non-Markovian search strategies with n-step memory
• Optimal navigation strategy of active Brownian particles in target-search problems
• Target search of active agents crossing high energy barriers
• On the convergence of projective-simulation-based reinforcement learning in Markov decision processes
• Learning how to find targets in the micro-world: The case of intermittent active Brownian particles
• Optimal foraging strategies can be learned

Cited by in corpus (6)

• Dynamics of switching processes: general results and applications to intermittent active motion
• Efficient Rare Event Sampling with Unsupervised Normalising Flows
• Learning how to find targets in the micro-world: The case of intermittent active Brownian particles
• Transition-path sampling for Run-and-Tumble particles
• Reinforcement Learning for Active Matter
• Run-and-Tumble Particles Learning Chemotaxis