Aggressive Post-Training Compression on Extremely Large Language Models

Zining Zhang, Yao Chen, Bingsheng He +1

The increasing size and complexity of Large Language Models (LLMs) pose challenges for their deployment on personal computers and mobile devices. Aggressive post-training model com…