Understanding Calibration and Truncation Error Propagation in Training-Free Low-Rank Compression for LLMs

Mohanad Odema, Gabrielle De Micheli, Dayin Gou +3

Training-free low-rank compression frameworks have been gaining prominence for LLM compression given their effectiveness in reducing model parameter count while maintaining task-le…