SAGA: Score-Weighted Adaptive Generation Alignment for Low-Resource Nordic Language Models

Hoda Fakharzadehjahromy, Emil Wiman, Andreas Bueff +2

Language models for low-resource languages still make frequent grammatical errors. Alignment methods such as RLHF and DPO can correct them. However, they require human judgements,…