120 citations · 188 across the 11 of their papers we have counts for
13 papers
Multi-objective Reinforcement Learning With Augmented States Requires Rewards After Deployment
Peter Vamplew, Cameron Foale
This research note identifies a previously overlooked distinction between multi-objective reinforcement learning (MORL), and more conventional single-objective reinforcement learni…
ES-C51: Expected Sarsa Based C51 Distributional Reinforcement Learning Algorithm
Rijul Tandon, Peter Vamplew, Cameron Foale
In most value-based reinforcement learning (RL) algorithms, the agent estimates only the expected reward for each action and selects the action with the highest reward. In contrast…
Multi-objective Reinforcement Learning: A Tool for Pluralistic Alignment
Peter Vamplew, Conor F Hayes, Cameron Foale +2
Reinforcement learning (RL) is a valuable tool for the creation of AI systems. However it may be problematic to adequately align RL based on scalar rewards if there are multiple co…
Utility-Based Reinforcement Learning: Unifying Single-objective and Multi-objective Reinforcement Learning
Peter Vamplew, Cameron Foale, Conor F. Hayes +9
Research in multi-objective reinforcement learning (MORL) has introduced the utility-based paradigm, which makes use of both environmental rewards and a function that defines the u…
Issues with Value-Based Multi-objective Reinforcement Learning: Value Function Interference and Overestimation Sensitivity
Peter Vamplew, Ethan, Watkins +2
Multi-objective reinforcement learning (MORL) algorithms extend conventional reinforcement learning (RL) to the more general case of problems with multiple, conflicting objectives,…
An Empirical Investigation of Value-Based Multi-objective Reinforcement Learning for Stochastic Environments
Kewen Ding, Peter Vamplew, Cameron Foale +1
One common approach to solve multi-objective reinforcement learning (MORL) problems is to extend conventional Q-learning by using vector Q-values in combination with a utility func…
Scalar reward is not enough: A response to Silver, Singh, Precup and Sutton (2021)
Peter Vamplew, Benjamin J. Smith, Johan Kallstrom +9
The recent paper `"Reward is Enough" by Silver, Singh, Precup and Sutton posits that the concept of reward maximisation is sufficient to underpin all intelligence, both natural and…
Levels of explainable artificial intelligence for human-aligned conversational explanations
Richard Dazeley, Peter Vamplew, Cameron Foale +3
Over the last few years there has been rapid research growth into eXplainable Artificial Intelligence (XAI) and the closely aligned Interpretable Machine Learning (IML). Drivers fo…
Persistent Rule-based Interactive Reinforcement Learning
Adam Bignold, Francisco Cruz, Richard Dazeley +2
Interactive reinforcement learning has allowed speeding up the learning process in autonomous agents by including a human trainer providing extra information to the agent in real-t…
Human Engagement Providing Evaluative and Informative Advice for Interactive Reinforcement Learning
Adam Bignold, Francisco Cruz, Richard Dazeley +2
Interactive reinforcement learning proposes the use of externally-sourced information in order to speed up the learning process. When interacting with a learner agent, humans may p…
A Conceptual Framework for Externally-influenced Agents: An Assisted Reinforcement Learning Review
Adam Bignold, Francisco Cruz, Matthew E. Taylor +4
A long-term goal of reinforcement learning agents is to be able to perform tasks in complex real-world scenarios. The use of external information is one way of scaling agents to mo…
Discrete-to-Deep Supervised Policy Learning
Budi Kurniawan, Peter Vamplew, Michael Papasimeon +2
Neural networks are effective function approximators, but hard to train in the reinforcement learning (RL) context mainly because samples are correlated. For years, scholars have g…
A Demonstration of Issues with Value-Based Multiobjective Reinforcement Learning Under Stochastic State Transitions
Peter Vamplew, Cameron Foale, Richard Dazeley
We report a previously unidentified issue with model-free, value-based approaches to multiobjective reinforcement learning in the context of environments with stochastic state tran…