2 papers
cs.CL2025
Better RAG using Relevant Information Gain
Marc Pickett, Jeremy Hartman, Ayan Kumar Bhowmick +2
A common way to extend the memory of large language models (LLMs) is by retrieval augmented generation (RAG), which inserts text retrieved from a larger memory into an LLM's contex…
cs.CL2025
Transformer Layers as Painters
Qi Sun, Marc Pickett, Aakash Kumar Nain +1
Despite their nearly universal adoption for large language models, the internal workings of transformers are not well understood. We aim to better understand the impact of removing…