1 citations · 1 across the 8 of their papers we have counts for
4 papers · 1 filter
CircuitTree: Composing Circuits into A Syllable Transcriber
Jiankun Wei, Ewan Dunbar, Gerald Penn
The goal of circuit discovery is to decompose a monolithic neural network into tiny modular subnetworks which are interpretable in the sense that each does an identifiable subtask.…
Sparse Weight and Edge Circuit Discovery in Transformer-based Acoustic Models
Jiankun Wei, Ewan Dunbar, Gerald Penn
Transformer-based foundation models are powerful but opaque, motivating Mechanistic Interpretation methods to uncover the black-box by identifying small computation subgraphs respo…
Do speech foundation models really learn words?
Robin Huo, Ewan Dunbar
Self-supervised speech foundation models are now used in a wide array of downstream applications, including traditional speech recognition and as the basis for tokens in speech-awa…
DiscoPhon: Benchmarking the Unsupervised Discovery of Phoneme Inventories With Discrete Speech Units
Maxime Poli, Manel Khentout, Angelo Ortiz Tandazo +3
We introduce DiscoPhon, a multilingual benchmark for evaluating unsupervised phoneme discovery from discrete speech units. DiscoPhon covers 6 dev and 6 test languages, chosen to sp…