TBP-mHC: full expressivity for manifold-constrained hyper connections through transportation polytopes

Anton Lyubinin

Hyper-Connections (HC) improve residual networks by introducing learnable mixing across multiple residual streams, but unconstrained mixing leads to training instability. Manifold-…