The Price equation reveals a universal force-metric-bias law of algorithmic learning and natural selection
arXiv:2507.18549 · doi:10.3390/e27111129
Abstract
Diverse learning algorithms, optimization methods, and natural selection share a common mathematical structure, despite their apparent differences. Here I show that a simple notational partitioning of change by the Price equation reveals a universal force-metric-bias (FMB) law: . The force drives improvement in parameters, , in proportion to the slope of performance with respect to the parameters. The metric rescales movement by inverse curvature. The bias adds momentum or changes in the frame of reference. The noise enables exploration. This framework unifies natural selection, Bayesian updating, Newton's method, stochastic gradient descent, stochastic Langevin dynamics, Adam optimization, and most other algorithms as special cases of the same underlying process. The Price equation also reveals why Fisher information, Kullback-Leibler divergence, and d'Alembert's principle arise naturally in learning dynamics. By exposing this common structure, the FMB law provides a principled foundation for understanding, comparing, and designing learning algorithms across disciplines.
arXiv commentVersion 2: fixed definition of force in abstract; Version 3: added citations and some minor editing
References in corpus (6)
- Variational Inference: A Review for Statisticians
- Natural selection. IV. The Price equation
- Natural selection maximizes Fisher information
- Dynamics of Bayesian Updating with Dependent Data and Misspecified Models
- The Price equation program: simple invariances unify population dynamics, thermodynamics, probability, information and inference
- d'Alembert's direct and inertial forces acting on populations: the Price equation and the fundamental theorem of natural selection