PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design

Wenqi Jiang, Shuai Zhang, Boran Han +3

Retrieval-augmented generation (RAG) can enhance the generation quality of large language models (LLMs) by incorporating external token databases. However, retrievals from large da…