167 citations · 401 across the 11 of their papers we have counts for
1 paper · 2 filters
Mohammad Pezeshki, Sékou-Oumar Kaba, Yoshua Bengio +3
We identify and formalize a fundamental gradient descent phenomenon resulting in a learning proclivity in over-parameterized neural networks. Gradient Starvation arises when cross-…