607 citations · 1.6k across the 38 of their papers we have counts for
11 papers · 2 filters
Understanding Knowledge Distillation in Non-autoregressive Machine Translation
Chunting Zhou, Graham Neubig, Jiatao Gu
Non-autoregressive machine translation (NAT) systems predict a sequence of output tokens in parallel, achieving substantial improvements in generation speed compared to autoregress…
Harnessing Indirect Training Data for End-to-End Automatic Speech Translation: Tricks of the Trade
Juan Pino, Liezl Puzon, Jiatao Gu +3
For automatic speech translation (AST), end-to-end approaches are outperformed by cascaded models that transcribe with automatic speech recognition (ASR), then translate with machi…
Depth-Adaptive Transformer
Maha Elbayad, Jiatao Gu, Edouard Grave +1
State of the art sequence-to-sequence models for large scale tasks perform a fixed number of computations for each input sequence regardless of whether it is easy or hard to proces…
Monotonic Multihead Attention
Xutai Ma, Juan Pino, James Cross +2
Simultaneous machine translation models start generating a target sequence before they have encoded or read the source sequence. Recent approaches for this task either apply a fixe…
Improved Variational Neural Machine Translation by Promoting Mutual Information
Arya D. McCarthy, Xian Li, Jiatao Gu +1
Posterior collapse plagues VAEs for text, especially for conditional text generation with strong autoregressive decoders. In this work, we address this problem in variational neura…
VizSeq: A Visual Analysis Toolkit for Text Generation Tasks
Changhan Wang, Anirudh Jain, Danlu Chen +1
Automatic evaluation of text generation tasks (e.g. machine translation, text summarization, image captioning and video description) usually relies heavily on task-specific metrics…