Run-and-Tumble Particles Learning Chemotaxis
arXiv:2507.23519 · doi:10.1039/d5sm01040c
Abstract
Through evolution, bacteria have developed the ability to perform chemotactic motion in order to find nourishment. By adopting a machine learning approach, we aim to understand how this behavior arises. We consider run-and-tumble agents able to tune the instantaneous probability of switching between the run and the tumble phase. When such agents are navigating in an environment characterized by a concentration field pointing towards a circular target, we investigate how a chemotactic strategy may be learned starting from unbiased run-and-tumble dynamics. We compare the learning performances of agents that sense only the instantaneous concentration with those of agents having a short-term memory that allows them to perform temporal comparisons. While both types of learning agents develop successful target-search policies, we demonstrate that those achieved by agents endowed with temporal comparison abilities are significantly more efficient, particularly when the initial distance from the target is large. Finally, we also show that when an additional length scale is imposed, for example by fixing the initial distance to the target, the learning agents can leverage this information to further improve their efficiency in locating the target.
arXiv comment10 pages, 3 figures
References in corpus (30)
- Active Particles in Complex and Crowded Environments
- Physics of Microswimmers - Single Particle Motion and Collective Behavior
- Statistical Mechanics of Interacting Run-and-Tumble Bacteria
- Intermittent search strategies
- Diffusive transport without detailed balance in motile bacteria: Does microbiology need statistical physics?
- Optimal search strategies for hidden targets
- Sedimentation, trapping, and rectification of dilute bacteria
- Steady state, relaxation and first-passage properties of a run-and-tumble particle in one-dimension
- Flow Navigation by Smart Microswimmers via Reinforcement Learning
- Bidimensional intermittent search processes: an alternative to Levy flights strategies
- Zermelo's problem: Optimal point-to-point navigation in 2D turbulent flows using Reinforcement Learning
- Robustness of optimal intermittent search strategies in dimension 1, 2 and 3
- The Bacterial Chemotactic Response Reflects a Compromise Between Transient and Steady State Behavior
- Machine learning strategies for path-planning microswimmers in turbulent flows
- Optimal steering of a smart active particle
- Finding Efficient Swimming Strategies in a Three Dimensional Chaotic Flow by Reinforcement Learning
- Self-learning how to swim at low Reynolds number
- Microswimmers learning chemotaxis with genetic algorithms
- Smart Inertial Particles
- Projective simulation for classical learning agents: a comprehensive investigation
- Reinforcement learning of optimal active particle navigation
- Adaptation and Optimal Chemotactic Strategy for E. Coli
- Motility of \textit{Escherichia coli} in a quasi-two-dimensional porous medium
- On the convergence of projective-simulation-based reinforcement learning in Markov decision processes
- Learning how to find targets in the micro-world: The case of intermittent active Brownian particles
- Optimal foraging strategies can be learned
- A novel approach to chemotaxis: active particles guided by internal clocks
- Learning optimal integration of spatial and temporal information in noisy chemotaxis
- Run-and-tumble chemotaxis using reinforcement learning
- Transition-path sampling for Run-and-Tumble particles