New vector transport operators extending a Riemannian CG algorithm to generalized Stiefel manifold with low-rank applications

Abstract

This paper proposes two innovative vector transport operators, leveraging the Cayley transform, for the generalized Stiefel manifold embedded with a non-standard metric. Specifically, it introduces the differentiated retraction and an approximation of the Cayley transform to the differentiated matrix exponential. These vector transports are demonstrated to satisfy the Ring-Wirth non-expansive condition under non-standard metrics, and one of them is also isometric. Building upon the novel vector transport operators, we extend the modified Polak-Ribi$\grave{e}$re-Polyak (PRP) conjugate gradient method to the generalized Stiefel manifold. Under a non-monotone line search condition, we prove our algorithm globally converges to a stationary point. The efficiency of the proposed vector transport operators is empirically validated through numerical experiments involving generalized eigenvalue problems and canonical correlation analysis.

References in corpus (7)

• Manopt, a Matlab toolbox for optimization on manifolds
• Global rates of convergence for nonconvex optimization on manifolds
• A new, globally convergent Riemannian conjugate gradient method
• A Dai-Yuan-type Riemannian conjugate gradient method with the weak Wolfe conditions
• Riemannian preconditioning
• An Extension of Fast Iterative Shrinkage-thresholding to Riemannian Optimization for Sparse Principal Component Analysis
• Decentralized projected Riemannian gradient method for smooth optimization on compact submanifolds

Cited by in corpus (2)

• A Riemannian gradient descent method for optimization on the indefinite Stiefel manifold
• A generalized canonical metric for optimization on the indefinite Stiefel manifold