Telescopic Language Models

Zhilin Guo, Boqiao Zhang, Hakan Aktas +14

One deployed language model must often serve many compute budgets, yet serving each budget still means a separate training or compression run per point. We train a Telescopic Langu…