Reinforcement Learning from Human Feedback with High-Confidence Safety Constraints

Yaswanth Chittepu, Blossom Metevier, Will Schwarzer +3

Existing approaches to language model alignment often treat safety as a tradeoff against helpfulness, which can lead to unacceptable responses in sensitive domains. To ensure relia…