How Does mHC Use Its Residual Streams? Selective Routing and Near-Identity Mixing

Pengxiang Zhao, Xing Li, Xianzhi Yu +2

Hyper-Connections and their manifold-constrained variant mHC widen a residual pathway from one stream to n, yet how trained models use this capacity remains unclear: how broadly bl…