Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention
Jing Huang, Daniel Wurgaft, Rachit Bansal +6
Larger models learn tasks smaller models do not. What drives this phenomenon? We develop a simple phenomenological argument that power-law scaling already suggests that a larger mo…
cs.LG2025
Random Scaling of Emergent Capabilities
Rosie Zhao, Tian Qin, David Alvarez-Melis +2
Language models famously improve under a smooth scaling law, but some specific capabilities exhibit sudden breakthroughs in performance. Advocates of "emergence" view these capabil…