2 citations · 7 across the 15 of their papers we have counts for
4 papers · 1 filter
Towards Fully-fledged GPU Multitasking via Proactive Memory Scheduling
Weihang Shen, Yinqiu Chen, Rong Chen +1
The limited HBM capacity has become the primary bottleneck for hosting an increasing number of larger-scale GPU tasks. While demand paging extends capacity via host DRAM, it incurs…
Holistic Heterogeneous Scheduling for Autonomous Applications using Fine-grained, Multi-XPU Abstraction
Mingcong Han, Weihang Shen, Rong Chen +2
Modern autonomous applications are increasingly utilizing multiple heterogeneous processors (XPUs) to accelerate different stages of algorithm modules. However, existing runtime sy…
Microsecond-scale Dynamic Validation of Idempotency for GPU Kernels
Mingcong Han, Weihang Shen, Guanwen Peng +2
We discovered that a GPU kernel can have both idempotent and non-idempotent instances depending on the input. These kernels, called conditionally-idempotent, are prevalent in real-…
Characterizing Network Requirements for GPU API Remoting in AI Applications
Tianxia Wang, Zhuofu Chen, Xingda Wei +3
GPU remoting is a promising technique for supporting AI applications. Networking plays a key role in enabling remoting. However, for efficient remoting, the network requirements in…