2 papers
cs.LG2026
Generalization in Learning: Eyring Formula and Predator-prey Model
S. V. Kozyrev, I. A. Lopatin, Alexander Pechen
In this work, generalization in machine learning is investigated using a predator-prey model. We overview biological and chemical interpretation of the stochastic gradient Langevin…
cond-mat.stat-mech2024
How to explain grokking
S. V. Kozyrev
Explanation of grokking (delayed generalization) in learning is given by modeling grokking by the stochastic gradient Langevin dynamics (Brownian motion) and applying the ideas of…