Escaping the Capacity Ceiling: Routing on the Stiefel Manifold for Bilinear SPD Layers

Isabella Costa Maia, Isabella C. Maia, Pedro L. C. Rodrigues +2

Deep networks on the symmetric positive-definite (SPD) manifold promise expressive representations by encoding data geometry as an inductive bias, but stacking BiMap layers with th…