2 papers
cs.AI2025
Purifying Task Vectors in Knowledge-Aware Subspace for Model Merging
Bang An, Yibo Yang, Philip Torr +1
Model merging aims to integrate task-specific abilities from individually fine-tuned models into a single model without extra training. In recent model merging methods, task vector…
cs.CL2025
Optimizing Singular Spectrum for Large Language Model Compression
Dengjie Li, Tiancheng Shen, Yao Zhou +7
Large language models (LLMs) have demonstrated remarkable capabilities, yet prohibitive parameter complexity often hinders their deployment. Existing singular value decomposition (…