374 citations · 941 across the 27 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.LG2020★ 8 cited
Traces of Class/Cross-Class Structure Pervade Deep Learning Spectra
Vardan Papyan
Numerous researchers recently applied empirical spectral analysis to the study of modern deep learning classifiers. We identify and discuss an important formal class/cross-class st…
cs.LG2020★ 374 cited
Prevalence of Neural Collapse during the terminal phase of deep learning training
Vardan Papyan, X. Y. Han, David L. Donoho
Modern practice for training classification deepnets involves a Terminal Phase of Training (TPT), which begins at the epoch where training error first vanishes; During TPT, the tra…