Model Directions, Not Words: Mechanistic Topic Models Using Sparse Autoencoders

Carolina Zheng, Nicolas Beltran-Velez, Sweta Karlekar +5

Traditional topic models are effective at uncovering latent themes in large text collections. However, due to their reliance on bag-of-words representations, they struggle to captu…