2 papers
cs.LG2025
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting
Rui Pan, Dylan Zhang, Hanning Zhang +6
Bilevel optimization has shown its utility across various machine learning settings, yet most algorithms in practice require second-order information, making it challenging to scal…
math.OC2025
Fully First-Order Methods for Decentralized Bilevel Optimization
Xiaoyu Wang, Xuxing Chen, Shiqian Ma +1
This paper focuses on decentralized stochastic bilevel optimization (DSBO) where agents only communicate with their neighbors. We propose Decentralized Stochastic Gradient Descent…