activity
20182022
most citedUnderstanding the impact of entropy on policy optimization

44 citations · 154 across the 10 of their papers we have counts for

collaborators

10 papers

cs.LG2022

Learning how to Interact with a Complex Interface using Hierarchical Reinforcement Learning

Gheorghe Comanici, Amelia Glaese, Anita Gergely +5

Hierarchical Reinforcement Learning (HRL) allows interactive agents to decompose complex problems into a hierarchy of sub-tasks. Higher-level tasks can invoke the solutions of lowe…

cs.LG2021

Temporally Abstract Partial Models

Khimya Khetarpal, Zafarali Ahmed, Gheorghe Comanici +1

Humans and animals have the ability to reason and make predictions about different courses of action at many time scales. In reinforcement learning, option models (Sutton, Precup \…

cs.LG2021★ 8 cited

AndroidEnv: A Reinforcement Learning Platform for Android

Daniel Toyama, Philippe Hamel, Anita Gergely +6

We introduce AndroidEnv, an open-source platform for Reinforcement Learning (RL) research built on top of the Android ecosystem. AndroidEnv allows RL agents to interact with a wide…

cs.AI2021★ 4 cited

Training a First-Order Theorem Prover from Synthetic Data

Vlad Firoiu, Eser Aygun, Ankit Anand +6

A major challenge in applying machine learning to automated theorem proving is the scarcity of training data, which is a key ingredient in training successful deep learning models.…

cs.LG2020★ 32 cited

What can I do here? A Theory of Affordances in Reinforcement Learning

Khimya Khetarpal, Zafarali Ahmed, Gheorghe Comanici +2

Reinforcement learning algorithms usually assume that all actions are always available to an agent. However, both people and animals understand the general link between the feature…

cs.LO2020★ 9 cited

Learning to Prove from Synthetic Theorems

Eser Aygün, Zafarali Ahmed, Ankit Anand +5

A major challenge in applying machine learning to automated theorem proving is the scarcity of training data, which is a key ingredient in training successful deep learning models.…

cs.LG2019★ 7 cited

Marginalized State Distribution Entropy Regularization in Policy Optimization

Riashat Islam, Zafarali Ahmed, Doina Precup

Entropy regularization is used to get improved optimization performance in reinforcement learning tasks. A common form of regularization is to maximize policy entropy to avoid prem…

stat.ML2019★ 43 cited

InfoBot: Transfer and Exploration via the Information Bottleneck

Anirudh Goyal, Riashat Islam, Daniel Strouse +5

A central challenge in reinforcement learning is discovering effective policies for tasks where rewards are sparsely distributed. We postulate that in the absence of useful reward…

cs.LG2018★ 44 cited

Understanding the impact of entropy on policy optimization

Zafarali Ahmed, Nicolas Le Roux, Mohammad Norouzi +1

Entropy regularization is commonly used to improve policy optimization in reinforcement learning. It is believed to help with \emph{exploration} by encouraging the selection of mor…

cs.LG2018★ 7 cited

VFunc: a Deep Generative Model for Functions

Philip Bachman, Riashat Islam, Alessandro Sordoni +1

We introduce a deep generative model for functions. Our model provides a joint distribution p(f, z) over functions f and latent variables z which lets us efficiently sample from th…