3 papers
cs.CL2026
How Far Does Second-Order Linear Response Predict Quantization Mismatch? Pre-Registered Measurements on Five Language Models
Dezhen Lu, Zixiang Ni
Serving systems choose a weight format for each model and deployment. A low-cost screen predicts the resulting KL divergence from the unquantized model's Fisher information using $…
cs.DC2026
What Sets the Serving Speed of Looped Language Models? Measurements and Optimizations Graded by Exactness
Dezhen Lu, Runguo Li, Zixiang Ni +5
Looped language models apply one block of layers many times per token, so a serving engine pays every per-layer overhead once per loop; we measure serving for Ouro and Huginn-0125…
cs.DC2026
Where KV-Cache Error Lives in Looped Language Models: A Diagnostic Study of Ouro and Huginn
Dezhen Lu, Runguo Li, Zixiang Ni +5
A looped language model applies one block of layers 4 times per token and keeps a key/value (KV) plane for each loop. We study where storage error changes the next-token distributi…