Cross-Lingual Generalization and Compression: From Language-Specific to Shared Neurons

Frederick Riemenschneider, Anette Frank

Multilingual language models (MLLMs) have demonstrated remarkable abilities to transfer knowledge across languages, despite being trained without explicit cross-lingual supervision…