410 citations · 964 across the 27 of their papers we have counts for
3 papers · 1 filter
Encode, Tag, Realize: High-Precision Text Editing
Eric Malmi, Sebastian Krause, Sascha Rothe +2
We propose LaserTagger - a sequence tagging approach that casts text generation as a text editing task. Target texts are reconstructed from the inputs using three main edit operati…
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks
Sascha Rothe, Shashi Narayan, Aliaksei Severyn
Unsupervised pre-training of large neural models has recently revolutionized Natural Language Processing. By warm-starting from the publicly released checkpoints, NLP practitioners…
Breaking the Softmax Bottleneck via Learnable Monotonic Pointwise Non-linearities
Octavian-Eugen Ganea, Sylvain Gelly, Gary Bécigneul +1
The Softmax function on top of a final linear layer is the de facto method to output probability distributions in neural networks. In many applications such as language models or t…