HedraRAG: Coordinating LLM Generation and Database Retrieval in Heterogeneous RAG Serving

Zhengding Hu, Vibha Murthy, Zaifeng Pan +4

This paper addresses emerging system-level challenges in heterogeneous retrieval-augmented generation (RAG) serving, where complex multi-stage workflows and diverse request pattern…