Random Search with Memory in Patchy Media: Exploration-Exploitation Tradeoff

Abstract

How to best exploit patchy resources? This long-standing question belongs to the extensively studied class of explore/exploit problems that arise in a wide range of situations, from animal foraging, to robotic exploration, and to human decision processes. Despite its broad relevance, the issue of optimal exploitation has previously only been tackled through two paradigmatic limiting models---patch-use and random search---that do not account for the interplay between searcher motion within patches and resource depletion. Here, we bridge this gap by introducing a minimal patch exploitation model that incorporates this coupling: the searcher depletes the resources along its random-walk trajectory within a patch and travels to a new patch after it takes $\mathcal{S}$ consecutive steps without finding resources. We compute the distribution of the amount of resources $F_t$ consumed by time $t$ for this non-Markovian random walker and show that exploring multiple patches is beneficial. In one dimension, we analytically derive the optimal strategy to maximize $F_t$. We show that this strategy is robust with respect to the distribution of resources within patches and the criterion for leaving a given patch. We also show that $F_t$ can be optimized in the ecologically-relevant case of two-dimensional patchy environments.

5 pages, 3 figures, plus 3 pages of supplemental material. V2: Final manuscript to appear in PRE

References in corpus (14)

• Diffusion with Stochastic Resetting
• Intermittent search strategies
• Diffusion with Optimal Resetting
• Optimal search strategies for hidden targets
• Diffusion under time-dependent resetting
• Diffusion with stochastic resetting at power-law times
• Non-equilibrium steady states of stochastic processes with intermittent resetting
• Optimizing persistent random searches
• Exploration and Trapping of Mortal Random Walkers
• Intermittent random walks for an optimal search strategy: One-dimensional case
• Depletion-Controlled Starvation of a Diffusing Forager
• Explore or exploit? A generic model and an exactly solvable case
• Composite random search strategies based on non-directional sensory cues
• Role of Depletion on the Dynamics of a Diffusing Forager

Cited by in corpus (7)

• Stochastic Resetting and Applications
• Depletion of Resources by a Population of Diffusing Species
• Optimally Frugal Foraging
• The distribution of first hitting times of non-backtracking random walks on Erdős-Rényi networks
• Unified approach to reset processes and application to coupling between process and reset
• Growth over time-correlated disorder: a spectral approach to Mean-field
• Proxitaxis: an adaptive search strategy based on proximity and stochastic resetting