Optimal steering of a smart active particle

Abstract

We formulate the theory for steering an active particle with optimal travel time between two locations and apply it to the Mexican hat potential without brim. For small heights the particle can cross the potential barrier, while for large heights it has to move around it. Thermal fluctuations in the orientation strongly affect the path over the barrier. Then we consider a smart active particle and apply reinforcement learning. We show how the active particle learns in repeating episodes to move optimally. The optimal steering is stored in the optimized action-value function, which is able to rectify thermal fluctuations.

arXiv comment7 pages, 6 figures

References in corpus (38)

• Active Particles in Complex and Crowded Environments
• The Mechanics and Statistics of Active Matter
• Motility-Induced Phase Separation
• Physics of Microswimmers - Single Particle Motion and Collective Behavior
• Dynamic clustering in active colloidal suspensions with chemical signaling
• A bacterial ratchet motor
• Sedimentation of active colloidal suspensions
• Emergent behavior in active colloids
• Topographical pathways guide chemical microswimmers
• Dancing Volvox: Hydrodynamic Bound States of Swimming Algae
• Turning bacteria suspensions into a "superfluid"
• Effective viscosity of microswimmer suspensions
• Nonlinear dynamics of a microswimmer in Poiseuille flow
• Clusters, asters and collective oscillations in chemotactic colloids
• Gravitaxis of asymmetric self-propelled colloidal particles
• Flow Navigation by Smart Microswimmers via Reinforcement Learning
• Diffusion, subdiffusion, and trapping of active particles in heterogeneous media
• Dynamic clustering and chemotactic collapse of self-phoretic active particles
• Active phase separation in mixtures of chemically interacting particles
• Transport powered by bacterial turbulence
• Active colloidal suspensions exhibit polar order under gravity
• Optimal noise maximizes collective motion in heterogeneous media
• Periodic and Quasiperiodic Motion of an Elongated Microswimmer in Poiseuille Flow
• Clustering and pattern formation in chemorepulsive active colloids
• Active Matter Transport and Jamming on Disordered Landscapes
• Flow-induced phase separation of active particles is controlled by boundary conditions
• Active Particles Bound by Information Flows
• Light-controlled Assembly of Active Colloidal Molecules
• The topography of the environment alters the optimal search strategy for active particles
• Optimal run-and-tumble based transportation of a Janus particle with active steering
• Finding Efficient Swimming Strategies in a Three Dimensional Chaotic Flow by Reinforcement Learning
• Rectification of self-propelled particles by symmetric barriers
• Destabilization of a flow focused suspension of magnetotactic bacteria
• Gravity-induced dynamics of a squirmer microswimmer in wall proximity
• Clustering of Magnetic Swimmers in a Poiseuille Flow
• Hydrodynamic assembly of active colloids: chiral spinners and dynamic crystals
• Collective Sedimentation of Squirmers under Gravity
• Markovian robots: minimal navigation strategies for active particles

Cited by in corpus (34)

• Zermelo's problem: Optimal point-to-point navigation in 2D turbulent flows using Reinforcement Learning
• Microswimmers learning chemotaxis with genetic algorithms
• Hydrodynamics can Determine the Optimal Route for Microswimmer Navigation
• Active matter under control: Insights from response theory
• Reinforcement learning of optimal active particle navigation
• Navigation of micro-swimmers in steady flow: the importance of symmetries
• Optimal active particle navigation meets machine learning
• Optimising low-Reynolds-number predation via optimal control and reinforcement learning
• Jeffery's orbits and microswimmers in flows: A theoretical review
• Effective Langevin equations for a polar tracer in an active bath
• Resetting mediated navigation of active Brownian searcher in a homogeneous topography
• Optimal navigation of microswimmers in complex and noisy environments
• Optimal navigation strategies for microswimmers on curved manifolds
• Hunting active Brownian particles: Learning optimal behavior
• Reinforcement Learning of Artificial Microswimmers
• Long-distance migration with minimal energy consumption in a thermal turbulent environment
• Energetic cost of microswimmer navigation: the role of body shape
• Learning how to find targets in the micro-world: The case of intermittent active Brownian particles
• The control of particles in the Stokes limit
• Active particles in moving traps: minimum work protocols and information efficiency of work extraction
• Escape Dynamics in an Anisotropically Driven Brownian Magneto-System
• Neuroevolution of Decentralized Decision-Making in N-Bead Swimmers Leads to Scalable and Robust Collective Locomotion
• Short term vs. long term: optimization of microswimmer navigation on different time horizons
• Closed-loop control of active nematic flows
• Efficient survival strategy for zooplankton in turbulence
• Adaptive active Brownian particles searching for targets of unknown positions
• Transition-path sampling for Run-and-Tumble particles
• Reinforcement Learning reveals fundamental limits on the mixing of active particles
• Reinforcement Learning for Active Matter
• Trapping Instability of an Active Particle in Steering Potential Fields
• Run-and-Tumble Particles Learning Chemotaxis
• A Hitchhiker's Guide To Active Motion
• Learning to traverse convective flows at moderate to high Rayleigh numbers
• Optimal navigation in two-dimensional flows: Control theory and reinforcement learning