ScAn-Bench: Evaluating Scaling Analysis Methodology

Artin Sermaxhaj, Nastaran Alipour, Donat Sinani +4

Recent progress in machine learning is driven by large-scale foundation models, where scaling laws and finding optimal scaling prescriptions for architecture, data, and hyperparame…