2 papers
cs.LG2026
Diet Your LLM: Dimension-wise Global Pruning of LLMs via Merging Task-specific Importance Score
Jimyung Hong, Jaehyung Kim
Large language models (LLMs) have demonstrated remarkable capabilities, but their massive scale poses significant challenges for practical deployment. Structured pruning offers a p…
cs.LG2025
Learning from the Undesirable: Robust Adaptation of Language Models without Forgetting
Yunhun Nam, Jaehyung Kim, Jongheon Jeong
Language models (LMs) are often adapted through supervised fine-tuning (SFT) to specialize their capabilities for downstream tasks. However, in typical scenarios where the fine-tun…