3 papers
cs.DC2026
HyperParallel: A Supernode-Affinity AI Framework
Xin Zhang, Beilei Sun, Teng Su +4
The emergence of large-scale, sparse, multimodal, and agentic AI models has coincided with a shift in hardware toward supernode architectures that integrate hundreds to thousands o…
cs.DB2025
RelServe: Fast LLM Inference Serving on Relational Data
Xin Zhang, Shihong Gao, Yanyan Shen +2
The use of Large Language Models (LLMs) for querying relational data has given rise to relQuery, a workload pattern that applies templated LLM calls to structured tables. As relQue…
cs.LG2025
Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving
Shihong Gao, Xin Zhang, Yanyan Shen +1
Large language model (LLM) inference serving systems are essential to various LLM-based applications. As demand for LLM services continues to grow, scaling these systems to handle…