REAL Sampling: Boosting Factuality and Diversity of Open-Ended Generation via Asymptotic Entropy

Haw-Shiuan Chang, Nanyun Peng, Mohit Bansal +2

Decoding methods for large language models (LLMs) usually struggle with the tradeoff between ensuring factuality and maintaining diversity. For example, a higher p threshold in the…