Learning Adaptive LLM Decoding

Chloe H. Su, Zhe Ye, Samuel Tenka +3

Decoding from large language models (LLMs) typically relies on fixed sampling hyperparameters (e.g., temperature, top-p), despite substantial variation in task difficulty and uncer…