3 papers
cs.OS2026
Herschel: Continuous Optimization of Production LLM Inference through On-Demand Profiling
Luping Wang, Weigao Chen, Yifei Wu +11
Model-as-a-service platforms call for continuous optimization as complex serving conditions expose inefficiencies missed before deployment. Detailed always-on profiling can incur s…
cs.PF2026
EMO: Energy Efficiency Modeling and Optimization for AI Workloads
Jiyu Luo, Shaoyu Chen, Jingwei Sun +3
The massive energy consumption of GPU-accelerated AI workloads challenges sustainable computing. We observe that execution asynchrony (e.g., CPU-GPU, concurrent streams, multi-GPU)…
cs.DC2023
Synthesizing Proxy Applications for MPI Programs
Jiyu Luo, Tao Yan, Qingguo Xu +2
Proxy applications (proxy-apps) are basic tools for evaluating the performance of specific workloads on high-performance computing (HPC) systems. Since the development of high-fide…