Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
xHC: Expanded Hyper-Connections
Xiangdong Zhang, Xiaohan Qin, Sunan Zou +10
Hyper-Connections (HC) expand the residual stream of Transformers into parallel streams, providing a form of memory scaling beyond model width and depth. Manifold-Constrained H…
cs.LG2019
Towards Better Understanding of Disentangled Representations via Mutual Information
Xiaojiang Yang, Wendong Bi, Yitong Sun +2
Most existing works on disentangled representation learning are solely built upon an marginal independence assumption: all factors in disentangled representations should be statist…