Consistency Training Can Entrench Misalignment

David Demitri Africa, Arathi Mani

Consistency training encourages a model to produce similar outputs across related inputs or sampling procedures. Such methods are simple, scalable, and largely label-free, but thei…