How to Leverage Demonstration Data in Alignment for Large Language Model? A Self-Imitation Learning Perspective

Teng Xiao, Mingxiao Li, Yige Yuan +3

This paper introduces a novel generalized self-imitation learning ($\text{GSIL}$) framework, which effectively and efficiently aligns large language models with offline demonstra…