Read the Room Before Your Model Generates

Muyao Kong, Zhihao Lin

Large language models (LLMs) generally rely on sampling temperature to regulate the amount of randomness in their outputs. Mainstream methods for selecting temperature typically in…