Sparsity-Aware Evolution for Model Merging

Huan Zhang, Yanjian Zhang, Guillaume Wisniewski +2

We propose a sparsity-aware evolutionary (SAE) framework for model merging that involves iterative pruning-merging cycles to act as a novel mutation operator. We incorporate the sp…