15 citations · 33 across the 10 of their papers we have counts for
1 paper · 1 filter
Jaisidh Singh, Diganta Misra, Antonio Orvieto
We investigate grokking in transformers through the lens of inductive bias: dispositions arising from architecture or optimization that let the network prefer one solution over ano…