9 papers · 1 filter
First-order methods on bounded-rank tensors converging to stationary points
Bin Gao, Renfeng Peng, Ya-xiang Yuan
Provably finding stationary points on bounded-rank tensors turns out to be an open problem [E. Levin, J. Kileel, and N. Boumal, Math. Program., 199 (2023), pp. 831--864] due to the…
Variational analysis of determinantal varieties
Yan Yang, Bin Gao, Ya-xiang Yuan
Determinantal varieties -- the sets of bounded-rank matrices or tensors -- have attracted growing interest in low-rank optimization. The tangent cone to low-rank sets is widely stu…
A space-decoupling framework for optimization on bounded-rank matrices with orthogonally invariant constraints
Yan Yang, Bin Gao, Ya-xiang Yuan
Imposing additional constraints on low-rank optimization has garnered growing interest. However, the geometry of coupled constraints hampers the well-developed low-rank structure a…
Distributed Retraction-Free and Communication-Efficient Optimization on the Stiefel Manifold
Yilong Song, Peijin Li, Bin Gao +1
Optimization problems on the Stiefel manifold, ranging from principal component analysis to enhancing neural network robustness, are ubiquitous in machine learning. The Landing alg…
Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity
Yan Yang, Bin Gao, Ya-xiang Yuan
Bilevel reinforcement learning (RL), which features intertwined two-level problems, has attracted growing interest recently. The inherent non-convexity of the lower-level RL proble…
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace
Yan Yang, Bin Gao, Ya-xiang Yuan
Bilevel optimization, with broad applications in machine learning, has an intricate hierarchical structure. Gradient-based methods have emerged as a common approach to large-scale…