20 citations · 20 across the 1 of their papers we have counts for
2 papers
cs.CL2025★ 2 cited
BrainWavLM: Fine-tuning Speech Representations with Brain Responses to Language
Nishitha Vattikonda, Aditya R. Vaidya, Richard J. Antonello +1
Speech encoding models use auditory representations to predict how the human brain responds to spoken language stimuli. Most performant encoding models linearly map the hidden stat…
cs.CL2022★ 20 cited
Self-supervised models of audio effectively explain human cortical responses to speech
Aditya R. Vaidya, Shailee Jain, Alexander G. Huth
Self-supervised language models are very effective at predicting high-level cortical responses during language comprehension. However, the best current models of lower-level audito…