Interpretable Embeddings of Speech Enhance and Explain Brain Encoding Performance of Audio Models

Riki Shimizu, Richard J. Antonello, Chandan Singh +1

Speech foundation models (SFMs) are increasingly hailed as powerful computational models of human speech perception. However, since their representations are inherently black-box,…