A History of Meta-gradient: Gradient Methods for Meta-learning
arXiv:2202.09701
Abstract
The history of meta-learning methods based on gradient descent is reviewed, focusing primarily on methods that adapt step-size (learning rate) meta-parameters.
3 pages of text, 54 references