5 citations · 5 across the 4 of their papers we have counts for
4 papers
HyperParallel: A Supernode-Affinity AI Framework
Xin Zhang, Beilei Sun, Teng Su +4
The emergence of large-scale, sparse, multimodal, and agentic AI models has coincided with a shift in hardware toward supernode architectures that integrate hundreds to thousands o…
RelServe: Fast LLM Inference Serving on Relational Data
Xin Zhang, Shihong Gao, Yanyan Shen +2
The use of Large Language Models (LLMs) for querying relational data has given rise to relQuery, a workload pattern that applies templated LLM calls to structured tables. As relQue…
Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving
Shihong Gao, Xin Zhang, Yanyan Shen +1
Large language model (LLM) inference serving systems are essential to various LLM-based applications. As demand for LLM services continues to grow, scaling these systems to handle…
SpanGNN: Towards Memory-Efficient Graph Neural Networks via Spanning Subgraph Training
Xizhi Gu, Hongzheng Li, Shihong Gao +3
Graph Neural Networks (GNNs) have superior capability in learning graph data. Full-graph GNN training generally has high accuracy, however, it suffers from large peak memory usage…