ManifoldFlow: Spectrum-Learnable Stiefel Optimization via SPD Relaxation

Haiwen Yi, Xinyuan Song

Orthogonal and Stiefel constraints are widely used in neural network optimization to control weight geometry, improve conditioning, and stabilize signal propagation. Yet standard S…