3 citations · 3 across the 11 of their papers we have counts for
5 papers · 1 filter
Sharper Analysis of Single-Loop Methods for Bilevel Optimization
Yubo Zhou, Jun Shu, Luo Luo +4
Bilevel optimization underpins many machine learning applications, including hyperparameter optimization, meta-learning, neural architecture search, and reinforcement learning. Whi…
Understanding the Generalization of Bilevel Programming in Hyperparameter Optimization: A Tale of Bias-Variance Decomposition
Yubo Zhou, Jun Shu, Junmin Liu +1
Gradient-based hyperparameter optimization (HPO) have emerged recently, leveraging bilevel programming techniques to optimize hyperparameter by estimating hypergradient w.r.t. vali…
On the Convergence of Single-Loop Stochastic Bilevel Optimization with Approximate Implicit Differentiation
Yubo Zhou, Luo Luo, Guang Dai +1
Stochastic Bilevel Optimization has emerged as a fundamental framework for meta-learning and hyperparameter optimization. Despite the practical prevalence of single-loop algorithms…
Rethinking Message Passing Neural Networks with Diffusion Distance-guided Stress Majorization
Haoran Zheng, Renchi Yang, Yubo Zhou +1
Message passing neural networks (MPNNs) have emerged as go-to models for learning on graph-structured data in the past decade. Despite their effectiveness, most of such models stil…
Towards Understanding The Calibration Benefits of Sharpness-Aware Minimization
Chengli Tan, Yubo Zhou, Haishan Ye +7
Deep neural networks have been increasingly used in safety-critical applications such as medical diagnosis and autonomous driving. However, many studies suggest that they are prone…