Progressive Feedforward Collapse of ResNet Training

Sicong Wang, Kuo Gai, Shihua Zhang

Neural collapse (NC) is a simple and symmetric phenomenon for deep neural networks (DNNs) at the terminal phase of training, where the last-layer features collapse to their class m…