15 citations · 30 across the 4 of their papers we have counts for
5 papers · 1 filter
Residual Energy-Based Models for Text Generation
Yuntian Deng, Anton Bakhtin, Myle Ott +2
Text generation is ubiquitous in many NLP tasks, from summarization, to dialogue and machine translation. The dominant parametric approach is based on locally normalized models whi…
Residual Energy-Based Models for Text
Anton Bakhtin, Yuntian Deng, Sam Gross +3
Current large-scale auto-regressive language models display impressive fluency and can generate convincing text. In this work we start by asking the question: Can the generations o…
Language Models as Knowledge Bases?
Fabio Petroni, Tim Rocktäschel, Patrick Lewis +4
Recent progress in pretraining language models on large textual corpora led to a surge of improvements for downstream NLP tasks. Whilst learning linguistic knowledge, these models…
Lightweight Adaptive Mixture of Neural and N-gram Language Models
Anton Bakhtin, Arthur Szlam, Marc'Aurelio Ranzato +1
It is often the case that the best performing language model is an ensemble of a neural language model with n-grams. In this work, we propose a method to improve how these two mode…
Streaming Small-Footprint Keyword Spotting using Sequence-to-Sequence Models
Yanzhang He, Rohit Prabhavalkar, Kanishka Rao +3
We develop streaming keyword spotting systems using a recurrent neural network transducer (RNN-T) model: an all-neural, end-to-end trained, sequence-to-sequence model which jointly…