4 citations · 6 across the 21 of their papers we have counts for
6 papers · 1 filter
gpu_ext: Extensible OS Policies for GPUs via eBPF
Yusheng Zheng, Tong Yu, Yiwei Yang +8
Performance in modern GPU-centric systems increasingly depends on resource management policies, including memory placement, scheduling, and observability. However, uniform policies…
Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference
Kexin Chu, Dawei Xiang, Zixu Shen +3
Mixture-of-Experts (MoE) has become a practical architecture for scaling LLM capacity while keeping per-token compute modest, but deploying MoE models on a single, memory-limited G…
CXLAimPod: CXL Memory is all you need in AI era
Yiwei Yang, Yusheng Zheng, Yiqi Chen +5
The proliferation of data-intensive applications, ranging from large language models to key-value stores, increasingly stresses memory systems with mixed read-write access patterns…
Selective KV-Cache Sharing to Mitigate Timing Side-Channels in LLM Inference
Kexin Chu, Zecheng Lin, Dawei Xiang +7
Global KV-cache sharing is an effective optimization for accelerating large language model (LLM) inference, yet it introduces an API-visible timing side channel that lets adversari…
HetGPU: The pursuit of making binary compatibility towards GPUs
Yiwei Yang, Yusheng Zheng, Tong Yu +1
Heterogeneous GPU infrastructures present a binary compatibility challenge: code compiled for one vendor's GPU will not run on another due to divergent instruction sets, execution…
Exploiting Control-flow Enforcement Technology for Sound and Precise Static Binary Disassembly
Brian Zhao, Yiwei Yang, Yusheng Zheng +1
Rewriting x86_64 binaries-whether for security hardening, dynamic instrumentation, or performance profiling is notoriously difficult due to variable-length instructions, interleave…