Aligning Sentence Embeddings to Human Concepts via Sparse Autoencoders

Wonseok Shin, Songkuk Kim

Dense sentence embeddings are fundamental to modern Retrieval-Augmented Generation (RAG) systems but suffer from a lack of interpretability due to feature superposition. This opaci…