Deep Neural Network Models Trained With A Fixed Random Classifier Transfer Better Across Domains

Hafiz Tiomoko Ali, Umberto Michieli, Ji Joong Moon +2

The recently discovered Neural collapse (NC) phenomenon states that the last-layer weights of Deep Neural Networks (DNN), converge to the so-called Equiangular Tight Frame (ETF) si…