activity
20192026
most citedTowards Understanding the Importance of Shortcut Connections in Residual Networks

22 citations · 45 across the 13 of their papers we have counts for

collaborators
Showing 2022 · stat.MLShow all

1 paper · 2 filters

stat.ML2022

Plateau in Monotonic Linear Interpolation -- A "Biased" View of Loss Landscape for Deep Networks

Xiang Wang, Annie N. Wang, Mo Zhou +1

Monotonic linear interpolation (MLI) - on the line connecting a random initialization with the minimizer it converges to, the loss and accuracy are monotonic - is a phenomenon that…