4 citations · 4 across the 3 of their papers we have counts for
3 papers
stat.ML2024
Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra
Roman Worschech, Bernd Rosenow
Neural scaling laws describe how the performance of deep neural networks scales with key factors such as training data size, model complexity, and training time, often following po…
cs.LG2023
Online Learning for the Random Feature Model in the Student-Teacher Framework
Roman Worschech, Bernd Rosenow
Deep neural networks are widely used prediction algorithms whose performance often improves as the number of weights increases, leading to over-parametrization. We consider a two-l…
cond-mat.dis-nn2021★ 4 cited
Soft Mode in the Dynamics of Over-realizable On-line Learning for Soft Committee Machines
Frederieke Richert, Roman Worschech, Bernd Rosenow
Over-parametrized deep neural networks trained by stochastic gradient descent are successful in performing many tasks of practical relevance. One aspect of over-parametrization is…