1 paper · 1 filter
Junxi Yan, Zixi Wei, Qingyao Ai +2
The cross-entropy scaling law has long served as a key tool for guiding the development of large language models. It shows that cross-entropy loss decreases in a predictable power-…