Disentangling Dense Embeddings with Sparse Autoencoders

Charles O'Neill, Christine Ye, Kartheik Iyer +1

Sparse autoencoders (SAEs) have shown promise in extracting interpretable features from complex neural networks. We present one of the first applications of SAEs to dense text embe…