1 citations · 2 across the 8 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Grokking Modular Polynomials
Darshil Doshi, Tianyu He, Aritra Das +1
Neural networks readily learn a subset of the modular arithmetic tasks, while failing to generalize on the rest. This limitation remains unmoved by the choice of architecture and t…
cs.LG2024
Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasks
Tianyu He, Darshil Doshi, Aritra Das +1
Large language models can solve tasks that were not present in the training set. This capability is believed to be due to in-context learning and skill composition. In this work, w…