Multimodal Reward Hacking in Reinforcement Learning

Jiayu Yao, Yiwei Wang, Anmeng Zhang +5

Reinforcement learning (RL) is increasingly used to align multimodal large language models (MLLMs), but higher rewards do not always imply better task performance. This risk is amp…