PISCO: Pretty Simple Compression for Retrieval-Augmented Generation

Maxime Louis, Hervé Déjean, Stéphane Clinchant

Retrieval-Augmented Generation (RAG) pipelines enhance Large Language Models (LLMs) by retrieving relevant documents, but they face scalability issues due to high inference costs a…