11 citations · 11 across the 8 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
q-bio.NC2024★ 11 cited
The Geometry of Concepts: Sparse Autoencoder Feature Structure
Yuxiao Li, Eric J. Michaud, David D. Baek +3
Sparse autoencoders have recently produced dictionaries of high-dimensional vectors corresponding to the universe of concepts represented by large language models. We find that thi…
cs.LG2024
Investigating Representation Universality: Case Study on Genealogical Representations
David D. Baek, Yuxiao Li, Max Tegmark
Motivated by interpretability and reliability, we investigate whether large language models (LLMs) deploy universal geometric structures to encode discrete, graph-structured knowle…
cs.LG2024
GenEFT: Understanding Statics and Dynamics of Model Generalization via Effective Theory
David D. Baek, Ziming Liu, Max Tegmark
We present GenEFT: an effective theory framework for shedding light on the statics and dynamics of neural network generalization, and illustrate it with graph learning examples. We…