Machine learning strategies for path-planning microswimmers in turbulent flows

Abstract

We develop an adversarial-reinforcement learning scheme for microswimmers in statistically homogeneous and isotropic turbulent fluid flows, in both two (2D) and three dimensions (3D). We show that this scheme allows microswimmers to find non-trivial paths, which enable them to reach a target on average in less time than a naive microswimmer, which tries, at any instant of time and at a given position in space, to swim in the direction of the target. We use pseudospectral direct numerical simulations (DNSs) of the 2D and 3D (incompressible) Navier-Stokes equations to obtain the turbulent flows. We then introduce passive microswimmers that try to swim along a given direction in these flows; the microswimmers do not affect the flow, but they are advected by it.

arXiv comment8 pages, 10 figures

References in corpus (5)

• Machine Learning for Fluid Mechanics
• Flow Navigation by Smart Microswimmers via Reinforcement Learning
• Zermelo's problem: Optimal point-to-point navigation in 2D turbulent flows using Reinforcement Learning
• Finding Efficient Swimming Strategies in a Three Dimensional Chaotic Flow by Reinforcement Learning
• Statistical Properties of Turbulence: An Overview

Cited by in corpus (28)

• Controlling Rayleigh-Bénard convection via Reinforcement Learning
• Microswimmers learning chemotaxis with genetic algorithms
• Hydrodynamics can Determine the Optimal Route for Microswimmer Navigation
• Searching for a source without gradients: how good is infotaxis and how to beat it
• Navigation of micro-swimmers in steady flow: the importance of symmetries
• Reinforcement learning for pursuit and evasion of microswimmers at low Reynolds number
• Surfing on turbulence: a strategy for planktonic navigation
• Optimal active particle navigation meets machine learning
• Optimising low-Reynolds-number predation via optimal control and reinforcement learning
• Jeffery's orbits and microswimmers in flows: A theoretical review
• Optimal tracking strategies in a turbulent flow
• Reinforcement Learning of Artificial Microswimmers
• Long-distance migration with minimal energy consumption in a thermal turbulent environment
• Efficient Rare Event Sampling with Unsupervised Normalising Flows
• Learning how to find targets in the micro-world: The case of intermittent active Brownian particles
• Taming Lagrangian Chaos with Multi-Objective Reinforcement Learning
• Short term vs. long term: optimization of microswimmer navigation on different time horizons
• Migration of self-propelling agent in a turbulent environment with minimal energy consumption
• Efficient survival strategy for zooplankton in turbulence
• Chemoreception and chemotaxis of a three-sphere swimmer
• A critical assessment of reinforcement learning methods for microswimmer navigation in complex flows
• Adaptive active Brownian particles searching for targets of unknown positions
• Reinforcement Learning for Active Matter
• Run-and-Tumble Particles Learning Chemotaxis
• Smart navigation of a gravity-driven glider with adjustable centre-of-mass
• Active gyrotactic stability of microswimmers using hydromechanical signals
• Orientation Dynamics of Gyrotactic Microswimmers in Turbulent Flows
• Optimal navigation in two-dimensional flows: Control theory and reinforcement learning