2 papers
cs.LG2025
On the Effect of Sampling Diversity in Scaling LLM Inference
Tianchun Wang, Zichuan Liu, Yuanzhou Chen +5
Large language model (LLM) scaling inference is key to unlocking greater performance, and leveraging diversity has proven an effective way to enhance it. Motivated by the observed…
cs.SE2024
Less is More: Towards Green Code Large Language Models via Unified Structural Pruning
Guang Yang, Yu Zhou, Xiangyu Zhang +5
The extensive application of Large Language Models (LLMs) in generative coding tasks has raised concerns due to their high computational demands and energy consumption. Unlike prev…