Personalized Speech recognition on mobile devices
arXiv:1603.03185
Abstract
We describe a large vocabulary speech recognition system that is accurate, has low latency, and yet has a small enough memory and computational footprint to run faster than real-time on a Nexus 5 Android smartphone. We employ a quantized Long Short-Term Memory (LSTM) acoustic model trained with connectionist temporal classification (CTC) to directly predict phoneme targets, and further reduce its memory footprint using an SVD-based compression scheme. Additionally, we minimize our memory footprint by using a single language model for both dictation and voice command domains, constructed using Bayesian interpolation. Finally, in order to properly handle device-specific information, such as proper names and other context-dependent information, we inject vocabulary items into the decoder graph and bias the language model on-the-fly. Our system achieves 13.5% word error rate on an open-ended dictation task, running with a median speed that is seven times faster than real-time.
Cited by in corpus (14)
- Optimizing Speech Recognition For The Edge
- On the Compression of Recurrent Neural Networks with an Application to LVCSR acoustic modeling for Embedded Speech Recognition
- VoiceMask: Anonymize and Sanitize Voice Input on Mobile Devices
- Streaming End-to-end Speech Recognition For Mobile Devices
- Gradient Scheduling with Global Momentum for Non-IID Data Distributed Asynchronous Training
- Deep context: end-to-end contextual speech recognition
- Simplified End-to-End MMI Training and Voting for ASR
- On the efficient representation and execution of deep acoustic models
- Streaming Small-Footprint Keyword Spotting using Sequence-to-Sequence Models
- A GPU-based WFST Decoder with Exact Lattice Generation
- Neural Composition: Learning to Generate from Multiple Models
- Linguistic Search Optimization for Deep Learning Based LVCSR
- Efficient and Privacy-preserving Voice-based Search over mHealth Data
- Adversarially Robust and Explainable Model Compression with On-Device Personalization for Text Classification