REAR: Test-time Preference Realignment through Reward Decomposition

Fuxiang Zhang, Pengcheng Wang, Chenran Li +6

Aligning large language models (LLMs) with diverse user preferences is a critical yet challenging task. While post-training methods can adapt models to specific needs, they often r…