Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
What Sets the Serving Speed of Looped Language Models? Measurements and Optimizations Graded by Exactness
Dezhen Lu, Runguo Li, Zixiang Ni +5
Looped language models apply one block of layers many times per token, so a serving engine pays every per-layer overhead once per loop; we measure serving for Ouro and Huginn-0125…
cs.DC2026
Where KV-Cache Error Lives in Looped Language Models: A Diagnostic Study of Ouro and Huginn
Dezhen Lu, Runguo Li, Zixiang Ni +5
A looped language model applies one block of layers 4 times per token and keeps a key/value (KV) plane for each loop. We study where storage error changes the next-token distributi…