1 citations · 2 across the 7 of their papers we have counts for
5 papers · 1 filter
Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexity
Mutian He, Philip N. Garner
Architectures such as Linformer and Mamba have recently emerged as competitive linear time replacements for transformers. However, corresponding large pretrained models are often u…
An investigation of modularity for noise robustness in conformer-based ASR
Louise Coppieters de Gibson, Philip N. Garner, Pierre-Edouard Honnet
Whilst state of the art automatic speech recognition (ASR) can perform well, it still degrades when exposed to acoustic environments that differ from those used when training the m…
A Bayesian Interpretation of Adaptive Low-Rank Adaptation
Haolin Chen, Philip N. Garner
Motivated by the sensitivity-based importance score of the adaptive low-rank adaptation (AdaLoRA), we utilize more theoretically supported metrics, including the signal-to-noise ra…
Exploring neural oscillations during speech perception via surrogate gradient spiking neural networks
Alexandre Bittar, Philip N. Garner
Understanding cognitive processes in the brain demands sophisticated models capable of replicating neural dynamics at large scales. We present a physiologically inspired speech rec…
Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting
Haolin Chen, Philip N. Garner
We are motivated primarily by the adaptation of text-to-speech synthesis models; however we argue that more generic parameter-efficient fine-tuning (PEFT) is an appropriate framewo…