Short term vs. long term: optimization of microswimmer navigation on different time horizons

Abstract

We use reinforcement learning to find strategies that allow microswimmers in turbulence to avoid regions of large strain. This question is motivated by the hypothesis that swimming microorganisms tend to avoid such regions to minimise the risk of predation. We ask which local cues a microswimmer must measure to efficiently avoid such straining regions. We find that it can succeed without directional information, merely by measuring the magnitude of the local strain. However, the swimmer avoids straining regions more efficiently if it can measure the sign of local strain gradients. We compare our results with those of an earlier study [Mousavi {\em et al.} Phys. Rev. Res. {\bf 6}, L022034 (2024)] where a short-time expansion was used to find optimal strategies. We find that the short-time strategies work well in some cases but not in others. We derive a new theory that explains when the time-horizon matters for our optimisation problem, and when it does not. We find the strategy with best performance when the time-horizon coincides with the correlation time of the turbulent fluctuations. We also explain how the update frequency (the frequency at which the swimmer updates its strategy) affects the found strategies. We find that higher update frequencies yield better performance.

20 pages, 8 figures

References in corpus (27)

• A public turbulence database cluster and applications to study Lagrangian evolution of velocity increments in turbulence
• Flow Navigation by Smart Microswimmers via Reinforcement Learning
• Statistical models for spatial patterns of heavy particles in turbulence
• Zermelo's problem: Optimal point-to-point navigation in 2D turbulent flows using Reinforcement Learning
• Machine learning with neural networks
• Machine learning strategies for path-planning microswimmers in turbulent flows
• Optimal steering of a smart active particle
• Finding Efficient Swimming Strategies in a Three Dimensional Chaotic Flow by Reinforcement Learning
• Accumulation of motile elongated micro-organisms in turbulence
• Preferential sampling and small-scale clustering of gyrotactic microswimmers in turbulence
• Clustering in mixing flows
• Hydrodynamics can Determine the Optimal Route for Microswimmer Navigation
• Statistical models for the dynamics of heavy particles in turbulence
• Programmable Control of Ultrasound Swarmbots through Reinforcement Learning
• Unmixing in Random Flows
• Light, Matter, Action: Shining light on active matter
• Alignment of non-spherical active particles in chaotic flows
• Navigation of micro-swimmers in steady flow: the importance of symmetries
• Surfing on turbulence: a strategy for planktonic navigation
• Copepods encounter rates from a model of escape jump behaviour in turbulence
• A Lagrangian model of copepod dynamics: Clustering by escape jumps in turbulence
• Long-distance migration with minimal energy consumption in a thermal turbulent environment
• Energetic cost of microswimmer navigation: the role of body shape
• Taming Lagrangian Chaos with Multi-Objective Reinforcement Learning
• Alignment of elongated swimmers in a laminar and turbulent Kolmogorov flow
• Caustic formation in a non-Gaussian model for turbulent aerosols
• Efficient survival strategy for zooplankton in turbulence

Cited by in corpus (2)

• Super-resolution reconstruction of turbulent flows from a single Lagrangian trajectory
• A critical assessment of reinforcement learning methods for microswimmer navigation in complex flows