When Entropy Is Not Enough: Reclaiming Lost Semantics in LLM Output Length Prediction

Feiyang Ren, Shengtao Wen, Lingbing Guo +3

Efficient LLM serving is often bottlenecked by the need to pad sequences to a fixed maximum length, and this wastes compute and degrades throughput. Predicting output lengths in ad…