FLEET: From Logits Entropy to Enhanced Trajectories in Text Generation

Oleksii Streltsov, Oleksandra Vitko

Solutions based on large language models (LLMs) often rely on temperature sampling to improve accuracy and stability by aggregating multiple samples from the completion distributio…