activity
20162026
most citedPrevalence of Neural Collapse during the terminal phase of deep learning training

374 citations · 941 across the 27 of their papers we have counts for

collaborators
Showing 2019Show all

2 papers · 1 filter

cs.LG2019★ 5 cited

Degrees of Freedom Analysis of Unrolled Neural Networks

Morteza Mardani, Qingyun Sun, Vardan Papyan +3

Unrolled neural networks emerged recently as an effective model for learning inverse maps appearing in image restoration tasks. However, their generalization risk (i.e., test mean-…

cs.LG2019★ 27 cited

Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians

Vardan Papyan

We consider deep classifying neural networks. We expose a structure in the derivative of the logits with respect to the parameters of the model, which is used to explain the existe…