Densing Law of LLMs

Chaojun Xiao, Jie Cai, Weilin Zhao +7

Large Language Models (LLMs) have emerged as a milestone in artificial intelligence, and their performance can improve as the model size increases. However, this scaling brings gre…