Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities

Enneng Yang, Li Shen, Guibing Guo +4

Model merging is an efficient empowerment technique in the machine learning community that does not require the collection of raw training data and does not require expensive compu…