activity
20162023
most citedLingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling

184 citations · 277 across the 10 of their papers we have counts for

collaborators

10 papers

cs.CL2023

Partial Rewriting for Multi-Stage ASR

Antoine Bruguier, David Qiu, Yanzhang He

For many streaming automatic speech recognition tasks, it is important to provide timely intermediate streaming results, while refining a high quality final result. This can be don…

eess.AS2023

Sharing Low Rank Conformer Weights for Tiny Always-On Ambient Speech Recognition Models

Steven M. Hernandez, Ding Zhao, Shaojin Ding +5

Continued improvements in machine learning techniques offer exciting new opportunities through the use of larger models and larger training datasets. However, there is a growing ne…

cs.CL2022

Neural-FST Class Language Model for End-to-End Speech Recognition

Antoine Bruguier, Duc Le, Rohit Prabhavalkar +7

We propose Neural-FST Class Language Model (NFCLM) for end-to-end speech recognition, a novel method that combines neural network language models (NNLMs) and finite state transduce…

cs.CL2020★ 1 cited

Improved Neural Language Model Fusion for Streaming Recurrent Neural Network Transducer

Suyoun Kim, Yuan Shangguan, Jay Mahadeokar +4

Recurrent Neural Network Transducer (RNN-T), like most end-to-end speech recognition model architectures, has an implicit neural network language model (NNLM) and cannot easily lev…

cs.CL2020★ 3 cited

A Streaming On-Device End-to-End Model Surpassing Server-Side Conventional Model Quality and Latency

Tara N. Sainath, Yanzhang He, Bo Li +26

Thus far, end-to-end (E2E) models have not been shown to outperform state-of-the-art conventional models with respect to both quality, i.e., word error rate (WER), and latency, i.e…

cs.CL2019★ 7 cited

Phoneme-Based Contextualization for Cross-Lingual Speech Recognition in End-to-End Models

Ke Hu, Antoine Bruguier, Tara N. Sainath +2

Contextual automatic speech recognition, i.e., biasing recognition towards a given context (e.g. user's playlists, or contacts), is challenging in end-to-end (E2E) models. Such mod…

cs.LG2019★ 184 cited

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling

Jonathan Shen, Patrick Nguyen, Yonghui Wu +88

Lingvo is a Tensorflow framework offering a complete solution for collaborative deep learning research, with a particular focus towards sequence-to-sequence models. Lingvo models a…

cs.CL2019★ 39 cited

On the Choice of Modeling Unit for Sequence-to-Sequence Speech Recognition

Kazuki Irie, Rohit Prabhavalkar, Anjuli Kannan +3

In conventional speech recognition, phoneme-based models outperform grapheme-based models for non-phonetic languages such as English. The performance gap between the two typically…

cs.CL2016

NN-grams: Unifying neural network and n-gram language models for Speech Recognition

Babak Damavandi, Shankar Kumar, Noam Shazeer +1

We present NN-grams, a novel, hybrid language model integrating n-grams and neural networks (NN) for speech recognition. The model takes as input both word histories as well as n-g…

cs.CL2016★ 43 cited

On the Compression of Recurrent Neural Networks with an Application to LVCSR acoustic modeling for Embedded Speech Recognition

Rohit Prabhavalkar, Ouais Alsharif, Antoine Bruguier +1

We study the problem of compressing recurrent neural networks (RNNs). In particular, we focus on the compression of RNN acoustic models, which are motivated by the goal of building…