Rule Based Rewards for Language Model Safety

Tong Mu, Alec Helyar, Johannes Heidecke +7

Reinforcement learning based fine-tuning of large language models (LLMs) on human preferences has been shown to enhance both their capabilities and safety behavior. However, in cas…