5 citations · 6 across the 19 of their papers we have counts for
12 papers · 1 filter
AgentPProf: Semantic Profiler for Long Horizon AI Agents
Yusheng Zheng, Chaokun Chang, Yu Mao +7
AI agents increasingly orchestrate long-running activities with users, tools, and system resources for days and weeks. To improve agent quality, safety, and cost efficiency, develo…
HBFSim: Fast and Faithful Simulation of High-Bandwidth Flash Under Real GPU Execution
Yanpeng Hu, Yiwei Yang, Yuanwu Zhu +3
High-Bandwidth Flash (HBF) places high-capacity NAND beside HBM to relieve the memory-capacity bottleneck of LLM inference, yet its system-level behavior cannot be evaluated before…
The Fabric Is the Cluster Driver: Cross-Layer eBPF Policies for GPU-CXL Fabrics
Yiwei Yang, Andi Quinn
We present fabric_ext, an eBPF middleware compiler and runtime for extensible OS policies over GPU--CXL fabrics. fabric_ext lets one policy program execute across GPU hooks, driver…
Characterizing and Bridging the Diagnostic Gap in eBPF Verifier Rejections
Yusheng Zheng, Zhengjie Ji, Weichen Tao +5
eBPF lets developers run custom programs inside the Linux kernel, where a verifier proves each program safe. However, when the verifier rejects a program, the unclear error makes r…
ActPlane: Programmable OS-Level Policy Enforcement for Agent Harnesses
Yusheng Zheng, Tianyuan Wu, Quanzhi Fu +6
AI agents increasingly run in production through harnesses, the software around the LLM, including an engine that enforces safety and effectiveness policies, e.g., 'run tests befor…
Kops: Safely Extending the eBPF Compilation Pipeline with Native Operations
Yusheng Zheng, Zhengjie Ji, Weichen Tao +4
eBPF safely extends OS kernels in domains such as networking, observability, and security. The safety comes from an in-kernel compilation pipeline where a verifier checks every pro…
Concordia: JIT-Compiled Persistent-Kernel Checkpointing for Fault-Tolerant LLM Inference
Yuhang Gan, Yiwei Yang, Yuyi Li +6
Long-running LLM agents keep valuable state resident on GPUs: KV caches, request schedulers, communication state, and sometimes online adapters. Losing this state after a GPU or co…
GPUOS: A GPU Operating System Primitive for Transparent Operation Fusion
Yiwei Yang, Xiangyu Gao, Yuan Zhou +3
Modern deep learning workloads often consist of many small tensor operations, especially in inference, attention, and micro-batched training. In these settings, kernel launch overh…
ReFlux: Reversible Compute Placement for CXL-Enabled Storage
Yanpeng Hu, Yiwei Yang, Yusheng Zheng +4
Static offload to computational storage devices proves brittle because device-side processors throttle under sustained thermal load, while opaque, vendor-specific interfaces inflat…
SysOM-AI: Continuous Cross-Layer Performance Diagnosis for Production AI Training
Yusheng Zheng, Wenan Mao, Shuyi Cheng +8
Performance diagnosis in production-scale AI training is challenging because subtle OS-level issues can trigger cascading GPU delays and network slowdowns, degrading training effic…
ACRFence: Preventing Semantic Rollback Attacks in Agent Checkpoint-Restore
Yusheng Zheng, Yiwei Yang, Wei Zhang +1
LLM agent frameworks increasingly offer checkpoint-restore for error recovery and exploration, advising developers to make external tool calls safe to retry. This advice assumes th…
AgentCgroup: Understanding and Controlling OS Resources of AI Agents
Yusheng Zheng, Jiakun Fan, Quanzhi Fu +3
AI agents are increasingly deployed in multi-tenant cloud environments, where they execute diverse tool calls within sandboxed containers, each call with distinct resource demands…