2 papers
cs.LG2026
Resolving Interference (RI): Disentangling Models for Improved Model Merging
Pratik Ramesh, George Stoica, Arun Iyer +2
Model merging has shown that multitask models can be created by directly combining the parameters of different models that are each specialized on tasks of interest. However, model…
cs.CV2024
Model merging with SVD to tie the Knots
George Stoica, Pratik Ramesh, Boglarka Ecsedi +2
Recent model merging methods demonstrate that the parameters of fully-finetuned models specializing in distinct tasks can be combined into one model capable of solving all tasks wi…