Beyond Unconstrained Features: Neural Collapse for Shallow Neural Networks with General Data

Wanli Hong, Shuyang Ling

Neural collapse (NC) is a phenomenon that emerges at the terminal phase of the training (TPT) of deep neural networks (DNNs). The features of the data in the same class collapse to…