most citedEfficient LLM Scheduling by Learning to Rank

1 citations · 2 across the 5 of their papers we have counts for

collaborators
Showing cs.LGShow all

2 papers · 1 filter

cs.LG2024★ 1 cited

Efficiently Scaling LLM Reasoning with Certaindex

Yichao Fu, Junda Chen, Siqi Zhu +8

Test-time reasoning algorithms such as chain-of-thought, self-consistency, and MCTS enhance LLM problem-solving but can wastefully generate many tokens without improving accuracy.…

cs.LG2024★ 1 cited

Efficient LLM Scheduling by Learning to Rank

Yichao Fu, Siqi Zhu, Runlong Su +3

In Large Language Model (LLM) inference, the output length of an LLM request is typically regarded as not known a priori. Consequently, most LLM serving systems employ a simple Fir…