1 citations · 1 across the 4 of their papers we have counts for
3 papers · 1 filter
Spectral Reach: Understanding Neural Scaling as Progress into the Spectral Tail
Konstantin Nikolaou, Jonas Scheunemann, Sven Krippendorf +2
Neural scaling laws describe predictable power-law relationships between model size, dataset size, compute, and performance. While these laws guide the development of modern founda…
Beyond Scaling Curves: Internal Dynamics of Neural Networks Through the NTK Lens
Konstantin Nikolaou, Sven Krippendorf, Samuel Tovey +1
Scaling laws offer valuable insights into the relationship between neural network performance and computational cost, yet their underlying mechanisms remain poorly understood. In t…
Collective variables of neural networks: empirical time evolution and scaling laws
Samuel Tovey, Sven Krippendorf, Michael Spannowsky +2
This work presents a novel means for understanding learning dynamics and scaling relations in neural networks. We show that certain measures on the spectrum of the empirical neural…