565 citations · 596 across the 4 of their papers we have counts for
7 papers
Interpreting Language Model Parameters
Lucius Bushnaq, Dan Braun, Oliver Clive-Griffin +5
Mechanistic interpretability aims to uncover how neural networks use their parameters to implement their impressive neural algorithms. Although previous work has uncovered substant…
Towards a mathematical theory of superposition
Michael I. Ivanitskiy, John Jasper, Emily J. King +1
We develop a mathematical theory of superposition in neural networks using tools from frame theory and compressed sensing. In our model, a sparse binary vector \(x\) of active feat…
LatticeVision: Image to Image Networks for Modeling Non-Stationary Spatial Data
Antony Sikorski, Michael Ivanitskiy, Nathan Lenssen +2
In many applications, we wish to fit a parametric statistical model to a small ensemble of spatially distributed random variables ('fields'). However, parameter inference using max…
Early Adoption of Generative Artificial Intelligence in Computing Education: Emergent Student Use Cases and Perspectives in 2023
C. Estelle Smith, Kylee Shiekh, Hayden Cooreman +8
Because of the rapid development and increasing public availability of Generative Artificial Intelligence (GenAI) models and tools, educational institutions and educators must imme…
Metric properties of partial and robust Gromov-Wasserstein distances
Jannatul Chhoa, Michael Ivanitskiy, Fushuai Jiang +4
The Gromov-Wasserstein (GW) distances define a family of metrics, based on ideas from optimal transport, which enable comparisons between probability measures defined on distinct m…
Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance
Kaitlyn Zhou, Jena D. Hwang, Xiang Ren +3
The ability to communicate uncertainty, risk, and limitation is crucial for the safety of large language models. However, current evaluations of these abilities rely on simple cali…
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448
Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…