Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
PISCO: Pretty Simple Compression for Retrieval-Augmented Generation
Maxime Louis, Hervé Déjean, Stéphane Clinchant
Retrieval-Augmented Generation (RAG) pipelines enhance Large Language Models (LLMs) by retrieving relevant documents, but they face scalability issues due to high inference costs a…
cs.CL2024
Let your LLM generate a few tokens and you will reduce the need for retrieval
Hervé Déjean
In this paper, we investigate how efficiently large language models (LLM) can be trained to check whether an answer is already stored in their parametric memory. We distill an LLM-…