Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization

Youran Dong, Junfeng Yang, Wei Yao +1

Bilevel optimization is a powerful tool for many machine learning problems, such as hyperparameter optimization and meta-learning. Estimating hypergradients (also known as implicit…