SuperValid: Capability-Aligned OOD Validation for Generalizable Downstream Scaling

Quanen Sun, Changxin Tian, Ke Shi +5

Scaling laws guide large language model training by relating compute to cross-entropy loss, and recent work further extends them to predict downstream benchmark performance. Howeve…