300 citations · 1.1k across the 11 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021★ 300 cited
Improving language models by retrieving from trillions of tokens
Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann +25
We enhance auto-regressive language models by conditioning on document chunks retrieved from a large corpus, based on local similarity with preceding tokens. With a trillion to…
cs.LG2021★ 6 cited
Reverb: A Framework For Experience Replay
Albin Cassirer, Gabriel Barth-Maron, Eugene Brevdo +4
A central component of training in Reinforcement Learning (RL) is Experience: the data used for training. The mechanisms used to generate and consume this data have an important ef…