2 papers
cs.CL2025
Model Directions, Not Words: Mechanistic Topic Models Using Sparse Autoencoders
Carolina Zheng, Nicolas Beltran-Velez, Sweta Karlekar +5
Traditional topic models are effective at uncovering latent themes in large text collections. However, due to their reliance on bag-of-words representations, they struggle to captu…
cs.CL2023
Revisiting Topic-Guided Language Models
Carolina Zheng, Keyon Vafa, David M. Blei
A recent line of work in natural language processing has aimed to combine language models and topic models. These topic-guided language models augment neural language models with t…