Weighted Ensemble Sampling for Rare-Event Estimation in Language Models

Zixuan Liu, Gustavo Didier, Fangzheng Wu +2

Rare but severe failures of large language models can become practically significant at deployment scale. Estimating their probabilities with direct Monte Carlo sampling is highly…