Functionality-Oriented LLM Merging on the Fisher--Rao Manifold

Jiayu Wang, Zuojun Ye, Wenpeng Yin

Weight-space merging aims to combine multiple fine-tuned LLMs into a single model without retraining, yet most existing approaches remain fundamentally parameter-space heuristics.…