Layer Swapping for Zero-Shot Cross-Lingual Transfer in Large Language Models

Lucas Bandarkar, Benjamin Muller, Pritish Yuvraj +4

Model merging, such as model souping, is the practice of combining different models with the same architecture together without further training. In this work, we present a model m…