Lightweight reranking for language model generations

Siddhartha Jain, Xiaofei Ma, Anoop Deoras +1

Large Language Models (LLMs) can exhibit considerable variation in the quality of their sampled outputs. Reranking and selecting the best generation from the sampled set is a popul…