Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
DeltaServe: Host-Agnostic Co-Serving of Inference and Fine-Tuning for LLMs
Jiaxuan Chen, Jianshu She, Ye Yuan +5
LLM serving systems are provisioned for peak load to meet strict latency targets, leaving substantial GPU compute idle whenever traffic falls below peak. We present DeltaServe, a h…
cs.DC2018
ADARES: Adaptive Resource Management for Virtual Machines
Ignacio Cano, Lequn Chen, Pedro Fonseca +5
Virtual execution environments allow for consolidation of multiple applications onto the same physical server, thereby enabling more efficient use of server resources. However, use…