Risk-Conditioned Fine-Tuning of Large Language Models

Zixuan Liu, Fangzheng Wu, Brian Summa +2

Large Language Models (LLMs) are increasingly deployed in settings where rare but severe harmful generations can have significant consequences. Existing Risk-Averse RLHF addresses…