20 citations · 20 across the 3 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.AR2026
CacheSmith: Accurate RAG Serving under Latency SLOs with Adaptive KV Reuse
Xinyue Ma, Damin Lee, Aashaka Shah +1
This paper presents CacheSmith, a KV cache reuse system for RAG prefill that maximizes quality-gated SLO attainment. While context caching lowers prefill latency by reusing precomp…
cs.DC2026
DIALER: A Case for Improving Rare-Class Accuracy in Retraining-Free Edge Video Analytics
Dongyoon Ryu, Sungho Jeon, Xinyue Ma +4
Edge video analytics with lightweight models is prone to accuracy degradation due to persistent distributional shifts in live video streams. While continuous learning (CL) addresse…
cs.AI2026
OrbitFlow: SLO-Aware Long-Context LLM Serving with Fine-Grained KV Cache Reconfiguration
Xinyue Ma, Heelim Hong, Taegeon Um +4
Serving long-context LLMs is challenging because request lengths and batch composition vary during token generation, causing the memory footprint to fluctuate significantly at runt…