RelServe: Fast LLM Inference Serving on Relational Data

Xin Zhang, Shihong Gao, Yanyan Shen +2

The use of Large Language Models (LLMs) for querying relational data has given rise to relQuery, a workload pattern that applies templated LLM calls to structured tables. As relQue…