BiSLS/SPS: Auto-tune Step Sizes for Stable Bi-level Optimization

Chen Fan, Gaspard Choné-Ducasse, Mark Schmidt +1

The popularity of bi-level optimization (BO) in deep learning has spurred a growing interest in studying gradient-based BO algorithms. However, existing algorithms involve two coup…