activity
20202026
most citedAn initial alignment between neural network and target is needed for gradient descent to learn

2 citations · 3 across the 8 of their papers we have counts for

collaborators
Showing 2021Show all

1 paper · 1 filter

cs.LG2021

Regularization by Misclassification in ReLU Neural Networks

Elisabetta Cornacchia, Jan Hązła, Ido Nachum +1

We study the implicit bias of ReLU neural networks trained by a variant of SGD where at each step, the label is changed with probability to a random label (label smoothing bein…