CASS: Contribution-Aware Structured Sparsity for Model Merging

Yan Li, Guiping Cao, Meng Xu +5

Model merging integrates task-specific fine-tuned models into a single multi-task model, but often suffers from parameter interference caused by conflicting task-vector updates. Ex…