activity
20232026
most citedBrainWavLM: Fine-tuning Speech Representations with Brain Responses to Language

2 citations · 2 across the 5 of their papers we have counts for

collaborators
Showing cs.CLShow all

7 papers · 1 filter

cs.CL2026

Fine-tuning language encoding models on slow fMRI improves prediction for fast ECoG

Aditya R. Vaidya, Richard J. Antonello, Alexander G. Huth

Neuroscientists have recently turned to intracranial brain recording methods, like electrocorticography (ECoG), for human experiments because of the fine spatial and temporal resol…

cs.CL2026

Abstraction Induces the Brain Alignment of Language and Speech Models

Emily Cheng, Aditya R. Vaidya, Richard Antonello

Research has repeatedly demonstrated that intermediate hidden states extracted from large language models and speech audio models predict measured brain response to natural languag…

cs.CL20252 cited

BrainWavLM: Fine-tuning Speech Representations with Brain Responses to Language

Nishitha Vattikonda, Aditya R. Vaidya, Richard J. Antonello +1

Speech encoding models use auditory representations to predict how the human brain responds to spoken language stimuli. Most performant encoding models linearly map the hidden stat…

cs.CL2024

Generative causal testing to bridge data-driven models and scientific theories in language neuroscience

Richard Antonello, Chandan Singh, Shailee Jain +5

Representations from large language models are highly effective at predicting BOLD fMRI responses to language stimuli. However, these representations are largely opaque: it is uncl…

cs.CL2024

Evidence from fMRI Supports a Two-Phase Abstraction Process in Language Models

Emily Cheng, Richard J. Antonello

Research has repeatedly demonstrated that intermediate hidden states extracted from large language models are able to predict measured brain response to natural language stimuli. Y…

cs.CL2024

Crafting Interpretable Embeddings by Asking LLMs Questions

Vinamra Benara, Chandan Singh, John X. Morris +4

Large language models (LLMs) have rapidly improved text embeddings for a growing array of natural-language processing tasks. However, their opaqueness and proliferation into scient…