Harmonia: End-to-End RAG Serving Optimization

Saurabh Agarwal, Bodun Hu, Luis Pabon +3

Retrieval-Augmented Generation (RAG) improves the reliability of large language models by integrating external knowledge, but serving RAG pipelines efficiently is challenging becau…