Showing 2025Show all
2 papers · 1 filter
cs.LG2025
Algorithm Development in Neural Networks: Insights from the Streaming Parity Task
Loek van Rossem, Andrew M. Saxe
Even when massively overparameterized, deep neural networks show a remarkable ability to generalize. Research on this phenomenon has focused on generalization within distribution,…
cs.LG2025
Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks
Devon Jarvis, Richard Klein, Benjamin Rosman +1
In spite of finite dimension ReLU neural networks being a consistent factor behind recent deep learning successes, a theory of feature learning in these models remains elusive. Cur…