2 papers
cs.LG2026
SLEM: Spectrum-Aware Latent Expert Merging
Dohyeon Kim, Bedionita Soro, Bruno Andreis +1
Mixture-of-Experts (MoE) models scale model capacity efficiently by activating only a small subset of experts for each input, while still requiring all parameters to be stored in m…
cs.LG2026
Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts
Dohyeon Kim, Bedionita Soro, Sung Ju Hwang
Mixture-of-Experts (MoE) architectures have emerged as a powerful paradigm for scaling model capacity while preserving efficient inference in large foundation models. However, most…