Microswimmers learning chemotaxis with genetic algorithms
arXiv:2101.12258 · doi:10.1073/pnas.2019683118
Abstract
Various microorganisms and some mammalian cells are able to swim in viscous fluids by performing nonreciprocal body deformations, such as rotating attached flagella or by distorting their entire body. In order to perform chemotaxis, i.e. to move towards and to stay at high concentrations of nutrients, they adapt their swimming gaits in a nontrivial manner. We propose a model how microswimmers are able to autonomously adapt their shape in order to swim in one dimension towards high field concentrations using an internal decision making machinery modeled by an artificial neural network. We present two methods to measure chemical gradients, spatial and temporal sensing, as known for swimming mammalian cells and bacteria, respectively. Using the NEAT genetic algorithm surprisingly simple neural networks evolve which control the shape deformations of the microswimmer and allow them to navigate in static and complex time-dependent chemical environments. By introducing noisy signal transmission in the neural network the well-known biased run-and-tumble motion emerges. Our work demonstrates that the evolution of a simple internal decision-making machinery, which we can fully interpret and is coupled to the environment, allows navigation in diverse chemical landscapes. These findings are of relevance for intracellular biochemical sensing mechanisms of single cells, or for the simple nervous system of small multicellular organisms such as C. elegans.
arXiv comment9 pages, 4 figures
References in corpus (19)
- Continuous control with deep reinforcement learning
- Machine Learning for Fluid Mechanics
- The hydrodynamics of swimming microorganisms
- Physics of Microswimmers - Single Particle Motion and Collective Behavior
- A high-bias, low-variance introduction to Machine Learning for physicists
- A Simplest Swimmer at Low Reynolds Number: Three Linked Spheres
- Bacterial hydrodynamics
- Emergent behavior in active colloids
- Flow Navigation by Smart Microswimmers via Reinforcement Learning
- Analytic results for the three-sphere swimmer at low Reynolds number
- Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks
- Origins of eukaryotic excitability
- The Bacterial Chemotactic Response Reflects a Compromise Between Transient and Steady State Behavior
- Machine learning strategies for path-planning microswimmers in turbulent flows
- Optimal steering of a smart active particle
- Finding Efficient Swimming Strategies in a Three Dimensional Chaotic Flow by Reinforcement Learning
- Self-learning how to swim at low Reynolds number
- Swimming strategy of settling elongated microswimmers by reinforcement learning
- Adversary A3C for Robust Reinforcement Learning
Cited by in corpus (19)
- Searching for a source without gradients: how good is infotaxis and how to beat it
- Reinforcement learning of optimal active particle navigation
- Navigation of micro-swimmers in steady flow: the importance of symmetries
- Collective behavior of self-steering active particles with velocity alignment and visual perception
- Independent Control and Path Planning of Microswimmers with a Uniform Magnetic Field
- Optimal active particle navigation meets machine learning
- Noisy Pursuit and Pattern Formation of Self-Steering Active Particles
- Hunting active Brownian particles: Learning optimal behavior
- Generalized Three-Sphere Microswimmers
- Learning how to find targets in the micro-world: The case of intermittent active Brownian particles
- Optimal Navigation in Microfluidics via the Optimization of a Discrete Loss
- Learning optimal integration of spatial and temporal information in noisy chemotaxis
- Neuroevolution of Decentralized Decision-Making in N-Bead Swimmers Leads to Scalable and Robust Collective Locomotion
- Stabilising viscous extensional flows using Reinforcement Learning
- Chemoreception and chemotaxis of a three-sphere swimmer
- The effect of axisymmetric confinement on propulsion of a three-sphere microswimmer
- Adaptive active Brownian particles searching for targets of unknown positions
- Reinforcement learning of a biflagellate model microswimmer
- Run-and-Tumble Particles Learning Chemotaxis