activity
20212026
most citedTransformer Language Models without Positional Encodings Still Learn Positional Information

4 citations · 8 across the 5 of their papers we have counts for

collaborators
Showing 2021Show all

2 papers · 1 filter

cs.CL2021

Can Latent Alignments Improve Autoregressive Machine Translation?

Adi Haviv, Lior Vassertail, Omer Levy

Latent alignment objectives such as CTC and AXE significantly improve non-autoregressive machine translation models. Can they improve autoregressive models as well? We explore the…

cs.CL2021

BERTese: Learning to Speak to BERT

Adi Haviv, Jonathan Berant, Amir Globerson

Large pre-trained language models have been shown to encode large amounts of world and commonsense knowledge in their parameters, leading to substantial interest in methods for ext…