AI Alignment Breaks at the Edge

Han Bao, Yue Huang, Xiaoda Wang +5

General Alignment has improved average-case helpfulness and safety, but current alignment practice still rewards confident, single-turn responses. The problem is not only that mode…