4 papers
Incremental Aggregation on the Grassmannian for Asynchronous Eigenspace Computation
Xiaolu Wang, Jiang Hu, Hoi-To Wai
We study asynchronous optimization for finite-sum eigenspace computation in heterogeneous distributed systems. The theoretical foundations for asynchronous eigenspace computation r…
A Sketch-and-Project Analysis of Subsampled Natural Gradient Algorithms
Gil Goldshlager, Jiang Hu, Lin Lin
Subsampled natural gradient descent (SNG) has been used to enable high-precision scientific machine learning, but standard analyses based on stochastic preconditioning fail to prov…
Worth Their Weight: Randomized and Regularized Block Kaczmarz Algorithms without Preprocessing
Gil Goldshlager, Jiang Hu, Lin Lin
Due to the ever growing amounts of data leveraged for machine learning and scientific computing, it is increasingly important to develop algorithms that sample only a small portion…
A Retraction-free Method for Nonsmooth Minimax Optimization over a Compact Manifold
Necdet Serhat Aybat, Jiang Hu, Zhanwang Deng
We study the minimax problem , where is a compact submanifold, is continuously differentiable in , is a closed, weak…