AAPA: Adversarially Anchored Preference Alignment for Post-Training of Large Language Models

Faqiang Qian, Kang An, Weikun Zhang +6

Post-training alignment of large language models often combines supervised fine-tuning (SFT) on expert demonstrations with reinforcement learning (RL) from preference or verifiable…