1 citations · 1 across the 7 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
LoopQ: Quantization for Looped Language Models
Rui Fang, Hsi-Wen Chen, Ming-Syan Chen +1
Looped language models (LoopLMs) increase effective computational depth by repeatedly applying shared Transformer blocks without increasing the parameter count. However, this reuse…
cs.LG2025
KV Admission: Learning What to Write for Efficient Long-Context LLM Inference
Yen-Chieh Huang, Pi-Cheng Hsiu, Rui Fang +1
Long-context LLM inference is bottlenecked by the quadratic attention complexity and linear Key-Value (KV) cache growth. Prior approaches mitigate this via post-hoc selection or ev…