On the Interpretability of Whisper Encodings Using Sparse Autoencoders

Dan Pluth, Zachary Nicholas Houghton, Yu Zhou +1

While deep transformer-based models have advanced rapidly, their internal mechanisms remain largely a mystery. Recent work has prioritized understanding text-based transformer mode…