Who Needs Decoders? Efficient Estimation of Sequence-level Attributes

Yassir Fathullah, Puria Radmard, Adian Liusie +1

State-of-the-art sequence-to-sequence models often require autoregressive decoding, which can be highly expensive. However, for some downstream tasks such as out-of-distribution (O…