Many Preferences, Few Policies: Compact Portfolios for Multi-Objective LLM Alignment

Cheol Woo Kim, Jai Moondra, Roozbeh Nahavandi +3

Aligning large language models (LLMs) requires balancing competing objectives such as helpfulness, harmlessness, and conciseness. The appropriate balance varies across users and ap…