3 papers
cs.LG2026
MaPPO: Maximum a Posteriori Preference Optimization with Prior Knowledge
Guangchen Lan, Sipeng Zhang, Tianle Wang +7
As the era of large language models (LLMs) unfolds, Preference Optimization (PO) methods have become a central approach to aligning LLMs with human preferences and improving perfor…
cs.CV2026
ACPO: Counteracting Likelihood Displacement in Vision-Language Alignment with Asymmetric Constraints
Kaili Huang, Hongming Zhang, Rui Shen +4
While Direct Preference Optimization (DPO) has become the de facto approach for aligning Large Vision-Language Models (LVLMs), it suffers from Likelihood Displacement, where the pr…
cs.CV2025
Bridging SFT and DPO for Diffusion Model Alignment with Self-Sampling Preference Optimization
Daoan Zhang, Guangchen Lan, Dong-Jun Han +8
Existing post-training techniques are broadly categorized into supervised fine-tuning (SFT) and reinforcement learning (RL) methods; the former is stable during training but suffer…