activity
20132025
most citedDistilling the Knowledge in a Neural Network

14.1k citations · 17.3k across the 36 of their papers we have counts for

collaborators
Showing cs.LGShow all

29 papers · 1 filter

cs.LG2023

Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model

Karsten Roth, Lukas Thede, Almut Sophia Koepke +3

Training deep networks requires various design decisions regarding for instance their architecture, data augmentation, or optimization. In this work, we find these training variati…

cs.LG20235 cited

AlphaStar Unplugged: Large-Scale Offline Reinforcement Learning

Michaël Mathieu, Sherjil Ozair, Srivatsan Srinivasan +21

StarCraft II is one of the most challenging simulated reinforcement learning environments; it is partially observable, stochastic, multi-agent, and mastering StarCraft II requires…

cs.LG20218 cited

The Benchmark Lottery

Mostafa Dehghani, Yi Tay, Alexey A. Gritsenko +5

The world of empirical machine learning (ML) strongly relies on benchmarks in order to determine the relative effectiveness of different algorithms and methods. This paper proposes…

cs.LG2021

Vector Quantized Models for Planning

Sherjil Ozair, Yazhe Li, Ali Razavi +3

Recent developments in the field of model-based RL have proven successful in a range of environments, especially ones where planning is essential. However, such successes have been…

cs.LG202019 cited

Strong Generalization and Efficiency in Neural Programs

Yujia Li, Felix Gimeno, Pushmeet Kohli +1

We study the problem of learning efficient algorithms that strongly generalize in the framework of neural program induction. By carefully designing the input / output interfaces of…

cs.LG2020

Retrospective Analysis of the 2019 MineRL Competition on Sample Efficient Reinforcement Learning

Stephanie Milani, Nicholay Topin, Brandon Houghton +5

To facilitate research in the direction of sample efficient reinforcement learning, we held the MineRL Competition on Sample Efficient Reinforcement Learning Using Human Priors at…