Explore or exploit? A generic model and an exactly solvable case

Abstract

Finding a good compromise between the exploitation of known resources and the exploration of unknown, but potentially more profitable choices, is a general problem, which arises in many different scientific disciplines. We propose a stylized model for these exploration-exploitation situations, including population or economic growth, portfolio optimisation, evolutionary dynamics, or the problem of optimal pinning of vortices or dislocations in disordered materials. We find the exact growth rate of this model for tree-like geometries and prove the existence of an optimal migration rate in this case. Numerical simulations in the one-dimensional case confirm the generic existence of an optimum.

5 pages 2 figures

References in corpus (2)

• Burgers Turbulence
• The universal high temperature regime of pinned elastic objects

Cited by in corpus (23)

• Localization transition induced by learning in random searches
• Bet-hedging strategies in expanding populations
• Geometric Brownian Motion under Stochastic Resetting: A Stationary yet Non-ergodic Process
• Depletion-Controlled Starvation of a Diffusing Forager
• On growth-optimal tax rates and the issue of wealth inequalities
• Depletion of Resources by a Population of Diffusing Species
• On integrable directed polymer models on the square lattice
• Exploration-exploitation tradeoffs dictate the optimal distributions of phenotypes for populations subject to fitness fluctuations
• Revisiting Directed Polymers with heavy-tailed disorder
• Optimally Frugal Foraging
• The crossing probability for directed polymers in random media
• Does Greed Help a Forager Survive?
• Random Search with Memory in Patchy Media: Exploration-Exploitation Tradeoff
• Crossing probability for directed polymers in random media: exact tail of the distribution
• Midpoint distribution of directed polymers in the stationary regime: exact result through linear response
• Mutually avoiding paths in random media and largests eigenvalues of random matrices
• Ergodicity breaking in wealth dynamics: The case of reallocating geometric Brownian motion
• Export dynamics as an optimal growth problem in the network of global economy
• The balance of growth and risk in population dynamics
• Interactive Restless Multi-armed Bandit Game and Swarm Intelligence Effect
• Evolution of cooperation in networked heterogeneous fluctuating environments
• Growth over time-correlated disorder: a spectral approach to Mean-field
• From Logistic Growth to Exponential Growth in a Population Dynamical Model