Publications (9)
What About Inputing Policy in Value Function: Policy Representation and Policy-extended Value Function Approximator
Hongyao Tang, Zhaopeng Meng, Jianye Hao +9
We study Policy-extended Value Function Approximator (PeVFA) in Reinforcement Learning (RL), which extends conventional value function approximator (VFA) to take as input not only…
Successor-Predecessor Intrinsic Exploration
Changmin Yu, Neil Burgess, Maneesh Sahani +1
Exploration is essential in reinforcement learning, particularly in environments where external rewards are sparse. Here we focus on exploration with intrinsic rewards, where the a…
Hierarchical Successor Representation for Robust Transfer
Changmin Yu, Máté Lengyel
The successor representation (SR) provides a powerful framework for decoupling predictive dynamics from rewards, enabling rapid generalisation across reward configurations. However…
Unsupervised representation learning with recognition-parametrised probabilistic models
William I. Walker, Hugo Soulat, Changmin Yu +1
We introduce a new approach to probabilistic unsupervised learning based on the recognition-parametrised model (RPM): a normalised semi-parametric hypothesis class for joint distri…
Structured Recognition for Generative Models with Explaining Away
Changmin Yu, Hugo Soulat, Neil Burgess +1
A key goal of unsupervised learning is to go beyond density estimation and sample generation to reveal the structure inherent within observed data. Such structure can be expressed…
DESTA: A Framework for Safe Reinforcement Learning with Markov Games of Intervention
David Mguni, Usman Islam, Yaqi Sun +7
Reinforcement learning (RL) involves performing exploratory actions in an unknown system. This can place a learning agent in dangerous and potentially catastrophic system states. C…