Estimating Rare Events in Language Models with Proper Evaluation

Nikita Y. Parulekar, Anqi Liu

Quantifying the risk of rare failures in language models, such as those triggered by adversarial distribution shifts or very large-scale deployments, requires estimating probabilit…