6 citations · 13 across the 8 of their papers we have counts for
4 papers · 1 filter
Train your classifier first: Cascade Neural Networks Training from upper layers to lower layers
Shucong Zhang, Cong-Thanh Do, Rama Doddipatla +3
Although the lower layers of a deep neural network learn features which are transferable across datasets, these layers are not transferable within the same dataset. That is, in gen…
When Can Self-Attention Be Replaced by Feed Forward Layers?
Shucong Zhang, Erfan Loweimi, Peter Bell +1
Recently, self-attention models such as Transformers have given competitive results compared to recurrent neural network systems in speech recognition. The key factor for the outst…
Cross lingual transfer learning for zero-resource domain adaptation
Alberto Abad, Peter Bell, Andrea Carmantini +1
We propose a method for zero-resource domain adaptation of DNN acoustic models, for use in low-resource situations where the only in-language training data available may be poorly…
Acoustic Model Adaptation from Raw Waveforms with SincNet
Joachim Fainberg, Ondřej Klejch, Erfan Loweimi +2
Raw waveform acoustic modelling has recently gained interest due to neural networks' ability to learn feature extraction, and the potential for finding better representations for a…