Bidirectional Preference Synthesis: Learning Prompt-Conditioned Preferences from Boundary Failures

Junbo Wang, Lidong Lu, Zhuoqun Li +4

Correction-based offline preference pipelines commonly treat model failures only as rejected responses under the original prompt. This supervision is incomplete for boundary failur…