activity
20192023
most citedTransformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale

30 citations · 51 across the 4 of their papers we have counts for

collaborators

5 papers

cs.LG2023

SynJax: Structured Probability Distributions for JAX

Miloš Stanojević, Laurent Sartran

The development of deep learning software libraries enabled significant progress in the field by allowing users to focus on modeling, while letting the library to take care of the…

cs.CL2022★ 21 cited

Continuous diffusion for categorical data

Sander Dieleman, Laurent Sartran, Arman Roshannai +11

Diffusion models have quickly become the go-to paradigm for generative modelling of perceptual signals (such as images and sound) through iterative refinement. Their success hinges…

cs.CL2022★ 30 cited

Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale

Laurent Sartran, Samuel Barrett, Adhiguna Kuncoro +3

We introduce Transformer Grammars (TGs), a novel class of Transformer language models that combine (i) the expressive power, scalability, and strong performance of Transformers and…

cs.CL2022

Enabling arbitrary translation objectives with Adaptive Tree Search

Wang Ling, Wojciech Stokowiec, Domenic Donato +4

We introduce an adaptive tree search algorithm, that can find high-scoring outputs under translation models that make no assumptions about the form or structure of the search objec…

cs.CL2019

Better Document-Level Machine Translation with Bayes' Rule

Lei Yu, Laurent Sartran, Wojciech Stokowiec +4

We show that Bayes' rule provides an effective mechanism for creating document translation models that can be learned from only parallel sentences and monolingual documents---a com…