Evolutionary Soups: Evolving Mixture-of-Experts for Multi-Objective LLM Alignment

Lingxiao Kong, Steffen Staab, Cong Yang +2

Large language models are increasingly required to generate responses that satisfy multiple competing objectives. Since optimal trade-offs depend on both user preferences and input…