2 citations · 5 across the 13 of their papers we have counts for
3 papers · 1 filter
UniMASK: Unified Inference in Sequential Decision Problems
Micah Carroll, Orr Paradise, Jessy Lin +8
Randomly masking and predicting word tokens has been a successful approach in pre-training language models for a variety of downstream tasks. In this work, we observe that the same…
A Theory of Unsupervised Translation Motivated by Understanding Animal Communication
Shafi Goldwasser, David F. Gruber, Adam Tauman Kalai +1
Neural networks are capable of translating between languages -- in some cases even between two languages where there is little or no access to parallel translations, in what is kno…
Towards Flexible Inference in Sequential Decision Problems via Bidirectional Transformers
Micah Carroll, Jessy Lin, Orr Paradise +8
Randomly masking and predicting word tokens has been a successful approach in pre-training language models for a variety of downstream tasks. In this work, we observe that the same…