Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
Nitsum: Serving Tiered LLM Requests with Adaptive Tensor Parallelism
Vikranth Srivatsa, Zijian He, Pu Guo +2
LLM serving is increasingly multi-tenant: the same deployment must handle latency-critical interactive requests and more relaxed background workloads under a fixed GPU budget. This…
cs.DC2026
VDCores: Resource Decoupled Programming and Execution for Asynchronous GPU
Zijian He, Adrian Sampson, Yiying Zhang +1
Modern GPUs increasingly rely on specialized and asynchronous hardware units to deliver high performance. Yet these units are often underutilized because today's GPU software stack…
cs.DC2024
DRust: Language-Guided Distributed Shared Memory with Fine Granularity, Full Transparency, and Ultra Efficiency
Haoran Ma, Yifan Qiao, Shi Liu +7
Despite being a powerful concept, distributed shared memory (DSM) has not been made practical due to the extensive synchronization needed between servers to implement memory cohere…