Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving
Shihong Gao, Xin Zhang, Yanyan Shen +1
Large language model (LLM) inference serving systems are essential to various LLM-based applications. As demand for LLM services continues to grow, scaling these systems to handle…
cs.LG2024
SpanGNN: Towards Memory-Efficient Graph Neural Networks via Spanning Subgraph Training
Xizhi Gu, Hongzheng Li, Shihong Gao +3
Graph Neural Networks (GNNs) have superior capability in learning graph data. Full-graph GNN training generally has high accuracy, however, it suffers from large peak memory usage…