Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
Lynx: Progressive Speculative Quantization for accelerating KV Transfer in Long-Context Inference
Wenchen Han, Gingfung Matthew Yeung, Marco Barletta +3
Long-context inference is increasingly common in large language model (LLM) serving, driven by retrieval-augmented generation and agentic systems. In disaggregated inference, these…
cs.DC2024
vPALs: Towards Verified Performance-aware Learning System For Resource Management
Guoliang He, Gingfung Yeung, Sheriffo Ceesay +1
Accurately predicting task performance at runtime in a cluster is advantageous for a resource management system to determine whether a task should be migrated due to performance de…