Accelerating Finite-Sum Bilevel Optimization with Fully First-Order Oracles

Qihao Zhou, Shanshui Niu

We study nonconvex--strongly-convex bilevel optimization with finite-sum objectives and fully first-order oracles. We propose Sampled Implicit Corrections for Bilevel Optimization…