3 papers
cs.DB2025
RelServe: Fast LLM Inference Serving on Relational Data
Xin Zhang, Shihong Gao, Yanyan Shen +2
The use of Large Language Models (LLMs) for querying relational data has given rise to relQuery, a workload pattern that applies templated LLM calls to structured tables. As relQue…
cs.LG2025
Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving
Shihong Gao, Xin Zhang, Yanyan Shen +1
Large language model (LLM) inference serving systems are essential to various LLM-based applications. As demand for LLM services continues to grow, scaling these systems to handle…
cs.LG2024
SpanGNN: Towards Memory-Efficient Graph Neural Networks via Spanning Subgraph Training
Xizhi Gu, Hongzheng Li, Shihong Gao +3
Graph Neural Networks (GNNs) have superior capability in learning graph data. Full-graph GNN training generally has high accuracy, however, it suffers from large peak memory usage…