Decoding-time Realignment of Language Models

Tianlin Liu, Shangmin Guo, Leonardo Bianco +7

Aligning language models with human preferences is crucial for reducing errors and biases in these models. Alignment techniques, such as reinforcement learning from human feedback…