2 papers
cs.LG2025
On the Effect of Sampling Diversity in Scaling LLM Inference
Tianchun Wang, Zichuan Liu, Yuanzhou Chen +5
Large language model (LLM) scaling inference is key to unlocking greater performance, and leveraging diversity has proven an effective way to enhance it. Motivated by the observed…
cs.LG2025
DISC: Dynamic Decomposition Improves LLM Inference Scaling
Jonathan Light, Wei Cheng, Benjamin Riviere +6
Inference scaling methods for LLMs often rely on decomposing problems into steps (or groups of tokens), followed by sampling and selecting the best next steps. However, these steps…