2 papers
cs.LG2025
Algorithm Development in Neural Networks: Insights from the Streaming Parity Task
Loek van Rossem, Andrew M. Saxe
Even when massively overparameterized, deep neural networks show a remarkable ability to generalize. Research on this phenomenon has focused on generalization within distribution,…
cs.LG2024
When Representations Align: Universality in Representation Learning Dynamics
Loek van Rossem, Andrew M. Saxe
Deep neural networks come in many sizes and architectures. The choice of architecture, in conjunction with the dataset and learning algorithm, is commonly understood to affect the…