167 citations · 401 across the 11 of their papers we have counts for
1 paper · 1 filter
Mohammad Pezeshki, Sékou-Oumar Kaba, Yoshua Bengio +3
We identify and formalize a fundamental gradient descent phenomenon resulting in a learning proclivity in over-parameterized neural networks. Gradient Starvation arises when cross-…