Can Language Models Discover Scaling Laws?

Haowei Lin, Haotian Ye, Wenzheng Feng +8

Discovering scaling laws for predicting model performance at scale is a fundamental and open-ended challenge, mostly reliant on slow, case specific human experimentation. To invest…