BrainWavLM: Fine-tuning Speech Representations with Brain Responses to Language

Nishitha Vattikonda, Aditya R. Vaidya, Richard J. Antonello +1

Speech encoding models use auditory representations to predict how the human brain responds to spoken language stimuli. Most performant encoding models linearly map the hidden stat…