Radio: Rate-Distortion Optimization for Large Language Model Compression

Sean I. Young

In recent years, the compression of large language models (LLMs) has emerged as a key problem in facilitating LLM deployment on resource-limited devices, reducing compute costs, an…