9 citations · 27 across the 9 of their papers we have counts for
10 papers
Quantization-Aware and Tensor-Compressed Training of Transformers for Natural Language Understanding
Zi Yang, Samridhi Choudhary, Siegfried Kunzmann +1
Fine-tuned transformer models have shown superior performances in many natural language tasks. However, the large model size prohibits deploying high-performance transformer models…
Dual-Attention Neural Transducers for Efficient Wake Word Spotting in Speech Recognition
Saumya Y. Sahai, Jing Liu, Thejaswi Muniyappa +8
We present dual-attention neural biasing, an architecture designed to boost Wake Words (WW) recognition and improve inference time latency on speech recognition tasks. This archite…
Contextual Adapters for Personalized Speech Recognition in Neural Transducers
Kanthashree Mysore Sathyendra, Thejaswi Muniyappa, Feng-Ju Chang +5
Personal rare word recognition in end-to-end Automatic Speech Recognition (E2E ASR) models is a challenge due to the lack of training data. A standard way to address this issue is…
Context-Aware Transformer Transducer for Speech Recognition
Feng-Ju Chang, Jing Liu, Martin Radfar +4
End-to-end (E2E) automatic speech recognition (ASR) systems often have difficulty recognizing uncommon words, that appear infrequently in the training data. One promising method, t…
FANS: Fusing ASR and NLU for on-device SLU
Martin Radfar, Athanasios Mouchtaris, Siegfried Kunzmann +1
Spoken language understanding (SLU) systems translate voice input commands to semantics which are encoded as an intent and pairs of slot tags and values. Most current SLU systems d…
Exploiting Large-scale Teacher-Student Training for On-device Acoustic Models
Jing Liu, Rupak Vignesh Swaminathan, Sree Hari Krishnan Parthasarathi +3
We present results from Alexa speech teams on semi-supervised learning (SSL) of acoustic models (AM) with experiments spanning over 3000 hours of GPU time, making our study one of…