Optimising low-Reynolds-number predation via optimal control and reinforcement learning

Abstract

We seek the best stroke sequences of a finite-size swimming predator chasing a non-motile point or finite--size prey at low Reynolds number. We use optimal control to seek the globally-optimal solutions for the former and RL for general situations. The predator is represented by a squirmer model that can translate forward and laterally, rotate and generate a stresslet flow. We identify the predator's best squirming sequences to achieve the time-optimal (TO) and efficiency-optimal (EO) predation. For a point prey, the TO squirmer executing translational motions favours a two-fold L-shaped trajectory that enables it to exploit the disturbance flow for accelerated predation; using a stresslet mode significantly expedites the EO predation, allowing the predator to catch the prey faster yet with lower energy consumption and higher predatory efficiency; the predator can harness its stresslet disturbance flow to suck the prey towards itself; compared to a translating predator, its compeer combining translation and rotation is less time--efficient, and the latter occasionally achieves the TO predation via retreating in order to advance. We also adopt RL to reproduce the globally-optimal predatory strategy of chasing a point prey, qualitatively capturing the crucial two--fold attribute of TO path. Using a numerically emulated RL environment, we explore the dependence of the optimal predatory path on the size of prey. Our results might provide useful information that help design synthetic microswimmers such as \textit{in vivo} medical micro-robots capable of capturing and approaching objects in viscous flows.

References in corpus (26)

• Hydrodynamics of self-propulsion near a boundary: predictions and accuracy of far-field approximations
• Flow Navigation by Smart Microswimmers via Reinforcement Learning
• Low-Reynolds number swimming in a capillary tube
• Learning to school in the presence of hydrodynamic interactions
• Squirming through shear-thinning fluids
• Optimal feeding is optimal swimming for all Péclet numbers
• Machine learning strategies for path-planning microswimmers in turbulent flows
• Fluid transport by individual microswimmers
• Active particles in viscosity gradients
• Optimal steering of a smart active particle
• Chemotactic predator-prey dynamics
• Self-learning how to swim at low Reynolds number
• Hydrodynamics can Determine the Optimal Route for Microswimmer Navigation
• Learning to swim in potential flow
• Hydrodynamics defines the stable swimming direction of spherical squirmers in a nematic liquid crystal
• Reinforcement learning of optimal active particle navigation
• Navigation of micro-swimmers in steady flow: the importance of symmetries
• Reinforcement learning for pursuit and evasion of microswimmers at low Reynolds number
• Encounter rates between bacteria and small sinking particles
• Swimming with a cage: Low-Reynolds-number locomotion inside a droplet
• Universal entrainment mechanism governs contact times with motile cells
• Active Cloaking in Stokes Flows via Reinforcement Learning
• Swimming strategy of settling elongated microswimmers by reinforcement learning
• Bifurcation dynamics of a particle-encapsulating droplet in shear flow
• Reinforcement Learning of Artificial Microswimmers
• Particle motion nearby rough surfaces

Cited by in corpus (9)

• Optimal active particle navigation meets machine learning
• Jeffery's orbits and microswimmers in flows: A theoretical review
• Noisy Pursuit and Pattern Formation of Self-Steering Active Particles
• Optimal tracking strategies in a turbulent flow
• Hydrodynamic pursuit by cognitive self-steering microswimmers
• Taming Lagrangian Chaos with Multi-Objective Reinforcement Learning
• Learning to swim efficiently in a nonuniform flow field
• Super-resolution reconstruction of turbulent flows from a single Lagrangian trajectory
• Learning to traverse convective flows at moderate to high Rayleigh numbers