39 citations · 158 across the 36 of their papers we have counts for
4 papers · 1 filter
Hard Way, The Only Way: Provable Merits of Training on Hardest Examples
Elvis Dohmatob
Despite a surge of empirical interest in the ``unreasonable effectiveness'' of drastic data pruning for AI systems, a unified theoretical understanding of this phenomenon remains e…
Exact Scaling Laws for a Random-Features Bigram Model
Julian Enoch, Elvis Dohmatob
Understanding neural scaling laws is increasingly important for theory and practice, yet first-principles explanations remain limited even in simple settings. In this work, we stud…
Statistical Vignettes on the Grokking Phenomenon
Baye Malick Gning, Elvis Dohmatob
In this work, we study grokking in a simple, analytically tractable setting whose rich phenomenology allows us to disentangle the effects of initialization, signal strength, weight…
Efficient Refusal Ablation in LLM through Optimal Transport
Geraldin Nanfack, Eugene Belilovsky, Elvis Dohmatob
Safety-aligned language models refuse harmful requests through learned refusal behaviors encoded in their internal representations. Recent activation-based jailbreaking methods cir…