Learning Retrieval Models with Sparse Autoencoders

Thibault Formal, Maxime Louis, Hervé Dejean +1

Sparse autoencoders (SAEs) provide a powerful mechanism for decomposing the dense representations produced by Large Language Models (LLMs) into interpretable latent features. We po…