Showing 2026Show all
2 papers · 1 filter
cs.AI2026
Function Over Form: Distributional Orthogonalization in Mixture-of-Experts with Replica Expert Mechanism
Jinfan He, Yunzhuo Liu, Kai Zhang +3
The scaling of LLMs increasingly relies on MoE architectures to decouple active computation from total parameter count. However, the efficacy of MoE is often constrained by expert…
cs.CL2026
Hy-MT2: A Family of Fast, Efficient and Powerful Multilingual Translation Models in the Wild
Mao Zheng, Zheng Li, Tao Chen +10
Hy-MT2 is a family of fast-thinking multilingual translation models designed for complex real-world scenarios. It includes three model sizes: 1.8B, 7B, and 30B-A3B (MoE), all of wh…