LLM Compression with Jointly Optimizing Architectural and Quantization choices

Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi +1

Deploying large language models (LLMs) is challenging due to their significant memory and computational requirements. While some methods address this by developing small or tiny la…