42 citations · 46 across the 12 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021
Regularization by Misclassification in ReLU Neural Networks
Elisabetta Cornacchia, Jan Hązła, Ido Nachum +1
We study the implicit bias of ReLU neural networks trained by a variant of SGD where at each step, the label is changed with probability to a random label (label smoothing bein…
cs.LG2021
A Johnson--Lindenstrauss Framework for Randomly Initialized CNNs
Ido Nachum, Jan Hązła, Michael Gastpar +1
How does the geometric representation of a dataset change after the application of each randomly initialized layer of a neural network? The celebrated Johnson--Lindenstrauss lemma…