86 citations · 86 across the 2 of their papers we have counts for
2 papers
cs.LG2022★ 86 cited
Beyond neural scaling laws: beating power law scaling via data pruning
Ben Sorscher, Robert Geirhos, Shashank Shekhar +2
Widely observed neural scaling laws, in which error falls off as a power of the training set size, model size, or both, have driven substantial performance improvements in deep lea…
q-bio.NC2022
A theory of learning with constrained weight-distribution
Weishun Zhong, Ben Sorscher, Daniel D Lee +1
A central question in computational neuroscience is how structure determines function in neural networks. The emerging high-quality large-scale connectomic datasets raise the quest…