Understanding Representation of Deep Equilibrium Models from Neural Collapse Perspective

Haixiang Sun, Ye Shi

Deep Equilibrium Model (DEQ), which serves as a typical implicit neural network, emphasizes their memory efficiency and competitive performance compared to explicit neural networks…