Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training

Junwon Ko, Dong-Jae Lee, Minchan Kwon +2

LLM agents for sequential decision tasks are often post-trained with trajectory-level outcome labels, but such labels provide little supervision for preserving multiple successful…