2.6k citations · 3.3k across the 23 of their papers we have counts for
5 papers · 1 filter
Generalized Inner Loop Meta-Learning
Edward Grefenstette, Brandon Amos, Denis Yarats +6
Many (but not all) approaches self-qualifying as "meta-learning" in deep learning and reinforcement learning fit a common pattern of approximating the solution to a nested optimiza…
On the adequacy of untuned warmup for adaptive optimization
Jerry Ma, Denis Yarats
Adaptive optimization algorithms such as Adam are widely used in deep learning. The stability of such algorithms is often improved with a warmup schedule for the learning rate. Mot…
Improving Sample Efficiency in Model-Free Reinforcement Learning from Images
Denis Yarats, Amy Zhang, Ilya Kostrikov +3
Training an agent to solve control tasks directly from high-dimensional images with model-free reinforcement learning (RL) has proven difficult. A promising approach is to learn a…
The Differentiable Cross-Entropy Method
Brandon Amos, Denis Yarats
We study the cross-entropy method (CEM) for the non-convex optimization of a continuous and parameterized objective function and introduce a differentiable variant that enables us…
Hierarchical Decision Making by Generating and Following Natural Language Instructions
Hengyuan Hu, Denis Yarats, Qucheng Gong +2
We explore using latent natural language instructions as an expressive and compositional representation of complex actions for hierarchical decision making. Rather than directly se…