Semi-Supervised Learning of Noisy Mixture of Experts Models

Oh-Ran Kwon, Gourab Mukherjee, Jacob Bien

The mixture of experts (MoE) model is a versatile framework for predictive modeling that has gained renewed interest in the age of large language models. A collection of predictive…