2 citations · 2 across the 4 of their papers we have counts for
3 papers · 1 filter
Everyone Was Right: Lexical Representations in Language Models Are Both Abstract and Holistic
Zachary Nicholas Houghton, Yu Zhou, Dan Pluth +2
Lexical representations can encode both abstract information and information specific to particular contexts. We investigate how these forms of information are organized in languag…
The Holistic Storage of Verb+Up Phrases in Text-based and Audio-based Language Models
Zachary Nicholas Houghton, Yu Zhou, Dan Pluth +2
One of the most central aspects of language processing is the ability to trade off between stored representations and abstract knowledge: one must retrieve stored representations,…
On the Interpretability of Whisper Encodings Using Sparse Autoencoders
Dan Pluth, Zachary Nicholas Houghton, Yu Zhou +1
While deep transformer-based models have advanced rapidly, their internal mechanisms remain largely a mystery. Recent work has prioritized understanding text-based transformer mode…