The Functional Structure of Post-Compression Recovery in Low-Rank LLMs

Zishan Shao, Liang Tian, Georgiy Zemlevskiy +10

Different low-rank compression methods can produce compressed LLMs that respond differently to the same post-compression recovery procedure, and relative advantages observed betwee…