A Declarative-Procedural Perspective on Expert Routing in Bilingual Mixture-of-Experts Language Models

Amrit Gopinath, Raghul, Durairaj Thenmozhi

We investigate whether Mixture-of-Experts (MoE) language models develop linguistically structured expert routing during bilingual language acquisition. Inspired by the Declarative-…