Distributed Retraction-Free and Communication-Efficient Optimization on the Stiefel Manifold

Yilong Song, Peijin Li, Bin Gao +1

Optimization problems on the Stiefel manifold, ranging from principal component analysis to enhancing neural network robustness, are ubiquitous in machine learning. The Landing alg…