6.4k citations · 7.6k across the 17 of their papers we have counts for
3 papers · 1 filter
Transformers for Supervised Online Continual Learning
Jorg Bornschein, Yazhe Li, Amal Rannen-Triki
Transformers have become the dominant architecture for sequence modeling tasks such as natural language processing or audio processing, and they are now even considered for tasks t…
Denoising Autoregressive Representation Learning
Yazhe Li, Jorg Bornschein, Ting Chen
In this paper, we explore a new generative approach for learning visual representations. Our method, DARL, employs a decoder-only Transformer to predict image patches autoregressiv…
Practical Kernel Tests of Conditional Independence
Roman Pogodin, Antonin Schrab, Yazhe Li +2
We describe a data-efficient, kernel-based approach to statistical testing of conditional independence. A major challenge of conditional independence testing is to obtain the corre…