MGAA: Multi-Granular Adaptive Allocation fof Low-Rank Compression of LLMs

Guangyan Li, Yongqiang Tang, Wensheng Zhang

The enormous parameter scale of large language models (LLMs) has made model compression a research hotspot, which aims to alleviate computational resource demands during deployment…