eACGM: Non-instrumented Performance Tracing and Anomaly Detection towards Machine Learning Systems

Ruilin Xu, Zongxuan Xie, Pengfei Chen

We present eACGM, a full-stack AI/ML system monitoring framework based on eBPF. eACGM collects real-time performance data from key hardware components, including the GPU and networ…