Geometric Analysis of Unconstrained Feature Models with $d=K$

Yi Shen, Shao Gu

Recently, interesting empirical phenomena known as Neural Collapse have been observed during the final phase of training deep neural networks for classification tasks. We examine t…