Large Language Models Explore by Latent Distilling

Yuanhao Zeng, Ao Lu, Lufei Li +3

Generating diverse responses is crucial for test-time scaling of large language models (LLMs), yet standard stochastic sampling mostly yields surface-level lexical variation, limit…