most citedApt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving

5 citations · 5 across the 3 of their papers we have counts for

collaborators
Showing cs.DBShow all

1 paper · 1 filter

cs.DB2025

RelServe: Fast LLM Inference Serving on Relational Data

Xin Zhang, Shihong Gao, Yanyan Shen +2

The use of Large Language Models (LLMs) for querying relational data has given rise to relQuery, a workload pattern that applies templated LLM calls to structured tables. As relQue…