6 citations · 20 across the 9 of their papers we have counts for
Showing 2023Show all
3 papers · 1 filter
cs.LG2023
Effective Bilevel Optimization via Minimax Reformulation
Xiaoyu Wang, Rui Pan, Renjie Pi +1
Bilevel optimization has found successful applications in various machine learning problems, including hyper-parameter optimization, data cleaning, and meta-learning. However, its…
math.OC2023★ 3 cited
Generalized Polyak Step Size for First Order Optimization with Momentum
Xiaoyu Wang, Mikael Johansson, Tong Zhang
In machine learning applications, it is well known that carefully designed learning rate (step size) schedules can significantly improve the convergence of commonly used first-orde…
math.NA2023
A Lifted Bregman Formulation for the Inversion of Deep Neural Networks
Xiaoyu Wang, Martin Benning
We propose a novel framework for the regularised inversion of deep neural networks. The framework is based on the authors' recent work on training feed-forward neural networks with…