5 citations · 5 across the 5 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
Stochastic Average Gradient : A Simple Empirical Investigation
Pascal Junior Tikeng Notsawo
Despite the recent growth of theoretical studies and empirical successes of neural networks, gradient backpropagation is still the most widely used algorithm for training such netw…
cs.LG2023
Predicting Grokking Long Before it Happens: A look into the loss landscape of models which grok
Pascal Jr. Tikeng Notsawo, Hattie Zhou, Mohammad Pezeshki +2
This paper focuses on predicting the occurrence of grokking in neural networks, a phenomenon in which perfect generalization emerges long after signs of overfitting or memorization…