24 citations · 68 across the 16 of their papers we have counts for
5 papers · 1 filter
A Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse
Junyi Li, Bin Gu, Heng Huang
In this paper, we propose a new Hessian inverse free Fully Single Loop Algorithm (FSLA) for bilevel optimization problems. Classic algorithms for bilevel optimization admit a doubl…
Enhanced Bilevel Optimization via Bregman Distance
Feihu Huang, Junyi Li, Shangqian Gao +1
Bilevel optimization has been recently used in many machine learning problems such as hyperparameter optimization, policy optimization, and meta learning. Although many bilevel opt…
BiAdam: Fast Adaptive Bilevel Optimization Methods
Feihu Huang, Junyi Li, Shangqian Gao
Bilevel optimization recently has attracted increased interest in machine learning due to its many applications such as hyper-parameter optimization and meta learning. Although man…
Compositional federated learning: Applications in distributionally robust averaging and meta learning
Feihu Huang, Junyi Li
In the paper, we propose an effective and efficient Compositional Federated Learning (ComFedL) algorithm for solving a new compositional Federated Learning (FL) framework, which fr…
SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients
Feihu Huang, Junyi Li, Heng Huang
Adaptive gradient methods have shown excellent performances for solving many machine learning problems. Although multiple adaptive gradient methods were recently studied, they main…