4 papers
CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation
Zhuoren Ye, Tianyu Wo, Dinghao Xue +4
Emerging LLM services increasingly host many sparse MoE models, yet most models receive sparse requests and remain cold. This creates a GPU memory problem: model weights are stable…
Maestro: Workload-Aware Cross-Cluster Scheduling for LLM-Based Multi-Agent Systems
Jinghao Wang, Xiao Zhou, Xiaoyang Sun +6
Large Language Model based Multi-Agent Systems (LLM-MAS) have emerged as a powerful paradigm for tackling complex tasks by breaking them into collaborative workflows of specialized…
An Improved Time Series Anomaly Detection by Applying Structural Similarity
Tiejun Wang, Rui Wang, Xudong Mou +4
Effective anomaly detection in time series is pivotal for modern industrial applications and financial systems. Due to the scarcity of anomaly labels and the high cost of manual la…
CAPMix: Robust KPI Anomaly Detection for AIOps in Noisy and Dynamic Environments
Xudong Mou, Rui Wang, Tiejun Wang +11
Time-series anomaly detection is crucial in AIOps for maintaining large-scale service reliability. In production, streams of Key Performance Indicators (KPI) are high-dimensional,…