Can Heterogeneous Language Models Be Fused?

Shilian Chen, Jie Zhou, Qin Chen +4

Model merging aims to integrate multiple expert models into a single model that inherits their complementary strengths without incurring the inference-time cost of ensembling. Rece…