Chunk-Distilled Language Modeling

Yanhong Li, Karen Livescu, Jiawei Zhou

We introduce Chunk-Distilled Language Modeling (CD-LM), an approach to text generation that addresses two challenges in current large language models (LLMs): the inefficiency of to…