activity
20232026
most citedThe Brain's Bitter Lesson: Scaling Speech Decoding With Self-Supervised Learning

1 citations · 1 across the 14 of their papers we have counts for

collaborators
Showing cs.LGShow all

14 papers · 1 filter

cs.LG2026

Removing Timing Shortcuts Improves Non-Invasive Brain-to-Text

Dulhan Jayalath, Oiwi Parker Jones

We find that major reported improvements in decoding words from non-invasive brain recordings are largely reproducible without any brain data. In the influential work of d'Ascoli e…

cs.LG2026

The 2026 PNPL Competition: Word Classification and Efficient Cross-Subject Generalisation in LibriBrain100

Francesco Mantegna, Gereon Elvers, Dulhan Jayalath +18

The ambition of the 2025 PNPL competition (Landau et al., 2025) was to launch a multi-year curriculum for non-invasive speech decoding. Designed to progress from foundational tasks…

cs.LG2026

A Common Measure of Communication for Speech Brain-Computer Interfaces

Dulhan Jayalath, Benjamin Ballyk, Oiwi Parker Jones

Speech brain-computer interfaces (speech BCIs) translate neural activity into language, offering a path towards restoring speech for people with paralysis and, more broadly, enabli…

cs.LG2026

LibriBrain100: One Hundred Hours of Broad and Deep MEG Data for Neural Speech Decoding at Scale

Francesco Mantegna, Dulhan Jayalath, Gereon Elvers +12

We introduce LibriBrain100, a large-scale MEG dataset for speech decoding designed from the ground up for reproducible, standardised evaluation. LibriBrain100 more than doubles the…

cs.LG2026

Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification

Erik Y. Wang, Sumeet R. Motwani, James V. Roggeveen +9

Can AI make progress on important, unsolved mathematical problems? Large language models are now capable of sophisticated mathematical and scientific reasoning, but whether they ca…

cs.LG2026

MEG-XL: Data-Efficient Brain-to-Text via Long-Context Pre-Training

Dulhan Jayalath, Oiwi Parker Jones

Clinical brain-to-text interfaces are designed for paralysed patients who cannot provide extensive training recordings. Pre-training improves data-efficient generalisation by learn…

cs.LG2025

Training AI Co-Scientists Using Rubric Rewards

Shashwat Goel, Rishi Hazra, Dulhan Jayalath +8

AI co-scientists are emerging as a tool to assist human researchers in achieving their research goals. A crucial feature of these AI co-scientists is the ability to generate a rese…

cs.LG2025

Compute as Teacher: Turning Inference Compute Into Reference-Free Supervision

Dulhan Jayalath, Shashwat Goel, Thomas Foster +5

Where do learning signals come from when there is no ground truth in post-training? We show that inference compute itself can serve as supervision. By generating parallel rollouts…

cs.LG2025

The 2025 PNPL Competition: Speech Detection and Phoneme Classification in the LibriBrain Dataset

Gilad Landau, Miran Özdogan, Gereon Elvers +15

The advance of speech decoding from non-invasive brain data holds the potential for profound societal impact. Among its most promising applications is the restoration of communicat…

cs.LG2025

LibriBrain: Over 50 Hours of Within-Subject MEG to Improve Speech Decoding Methods at Scale

Miran Özdogan, Gilad Landau, Gereon Elvers +5

LibriBrain represents the largest single-subject MEG dataset to date for speech decoding, with over 50 hours of recordings -- 5 larger than the next comparable dataset and…

cs.LG2025

Unlocking Non-Invasive Brain-to-Text

Dulhan Jayalath, Gilad Landau, Oiwi Parker Jones

Despite major advances in surgical brain-to-text (B2T), i.e. transcribing speech from invasive brain recordings, non-invasive alternatives have yet to surpass even chance on standa…

cs.LG2024★ 1 cited

The Brain's Bitter Lesson: Scaling Speech Decoding With Self-Supervised Learning

Dulhan Jayalath, Gilad Landau, Brendan Shillingford +2

The past few years have seen remarkable progress in the decoding of speech from brain activity, primarily driven by large single-subject datasets. However, due to individual variat…

cs.LG2023

Does Double Descent Occur in Self-Supervised Learning?

Alisia Lupidi, Yonatan Gideoni, Dulhan Jayalath

Most investigations into double descent have focused on supervised models while the few works studying self-supervised settings find a surprising lack of the phenomenon. These resu…

cs.LG2023

Recursive Algorithmic Reasoning

Jonas Jürß, Dulhan Jayalath, Petar Veličković

Learning models that execute algorithms can enable us to address a key problem in deep learning: generalizing to out-of-distribution data. However, neural networks are currently un…