Estimating Great Expectations Under Autoregressive Language Models with Potentials

Francesco I. Re, Shubhangi Ghosh, Tim Vieira +1

Many applications of language models require estimating the expectation of a test functional under the model. Obtaining precise estimates can be computationally expensive. We show…