Towards Demystifying the Generalization Behaviors When Neural Collapse Emerges

Peifeng Gao, Qianqian Xu, Yibo Yang +5

Neural Collapse (NC) is a well-known phenomenon of deep neural networks in the terminal phase of training (TPT). It is characterized by the collapse of features and classifier into…