5 papers
CCL-D: A High-Precision Diagnostic System for Slow and Hang Anomalies in Large-Scale Model Training
Yida Gu, Fakang Wang, Jianhao Fu +17
As training scales grow, collective communication libraries (CCL) increasingly face anomalies arising from complex interactions among hardware, software, and environmental factors.…
Lightening the Load: A Cluster-Based Framework for A Lower-Overhead, Provable Website Fingerprinting Defense
Khashayar Khajavi, Tao Wang
Website fingerprinting (WF) attacks remain a significant threat to encrypted traffic, prompting the development of a wide range of defenses. Among these, two prominent classes are…
Deep GraphRAG: A Balanced Approach to Hierarchical Retrieval and Adaptive Integration
Yuejie Li, Ke Yang, Tao Wang +3
Graph-based Retrieval-Augmented Generation (GraphRAG) frameworks face a trade-off between the comprehensiveness of global search and the efficiency of local search. Existing method…
EPARA: Parallelizing Categorized AI Inference in Edge Clouds
Yubo Wang, Yubo Cui, Tuo Shi +5
With the increasing adoption of AI applications such as large language models and computer vision AI, the computational demands on AI inference systems are continuously rising, mak…
SALS: Sparse Attention in Latent Space for KV cache Compression
Junlin Mu, Hantao Huang, Jihang Zhang +3
Large Language Models capable of handling extended contexts are in high demand, yet their inference remains challenging due to substantial Key-Value cache size and high memory band…