Every Sample Counts: Supervised Fine-Tuning of Language Models with Pointwise Constraints

Ignacio Hounie, Ignacio Boero, Alejandro Ribeiro

Fine-tuning language models often requires enforcing constraints on individual inputs without compromising downstream performance. Existing constrained alignment methods impose con…