Adaptive Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization

Yixin Ji, Yang Xiang, Juntao Li +6

In recent years, large language models (LLMs) have driven advances in natural language processing. Still, their growing scale has increased the computational burden, necessitating…