Predicting LLM Safety Before Release by Simulating Deployment

Marcus Williams, Hannah Sheahan, Cameron Raymond +8

Pre-deployment safety evaluations aim to inform the downstream risks of releasing a new AI model. Yet most evaluations provide limited evidence about how often undesired model beha…