GDPO: Learning to Directly Align Language Models with Diversity Using GFlowNets

Oh Joon Kwon, Daiki E. Matsunaga, Kee-Eung Kim

A critical component of the current generation of language models is preference alignment, which aims to precisely control the model's behavior to meet human needs and values. The…