Multi-Objective Deep Reinforcement Learning

Abstract

We propose Deep Optimistic Linear Support Learning (DOL) to solve high-dimensional multi-objective decision problems where the relative importances of the objectives are not known a priori. Using features from the high-dimensional inputs, DOL computes the convex coverage set containing all potential optimal solutions of the convex combinations of the objectives. To our knowledge, this is the first time that deep reinforcement learning has succeeded in learning multi-objective policies. In addition, we provide a testbed with two experiments to be used as a benchmark for deep multi-objective reinforcement learning.

References in corpus (7)

• End-to-End Training of Deep Visuomotor Policies
• Learning to Communicate with Deep Multi-Agent Reinforcement Learning
• Action-Conditional Video Prediction using Deep Networks in Atari Games
• Massively Parallel Methods for Deep Reinforcement Learning
• Incentivizing Exploration In Reinforcement Learning With Deep Predictive Models
• Move Evaluation in Go Using Deep Convolutional Neural Networks
• Data-Efficient Learning of Feedback Policies from Image Pixels using Deep Dynamical Models

Cited by in corpus (21)

• Deep Reinforcement Learning for Multi-objective Optimization
• A Multi-Objective Deep Reinforcement Learning Framework
• Multi-Objective Multi-Agent Decision Making: A Utility-based Analysis and Survey
• Levels of explainable artificial intelligence for human-aligned conversational explanations
• Deep Learning and Knowledge-Based Methods for Computer Aided Molecular Design -- Toward a Unified Approach: State-of-the-Art and Future Directions
• A Generalized Algorithm for Multi-Objective Reinforcement Learning and Policy Adaptation
• A Lyapunov-based Approach to Safe Reinforcement Learning
• MO-MIX: Multi-Objective Multi-Agent Cooperative Decision-Making With Deep Reinforcement Learning
• Dynamic Weights in Multi-Objective Deep Reinforcement Learning
• PrefixRL: Optimization of Parallel Prefix Circuits using Deep Reinforcement Learning
• Bridging adaptive management and reinforcement learning for more robust decisions
• Value constrained model-free continuous control
• A Practical Guide to Multi-Objective Reinforcement Learning and Planning
• Accommodating Picky Customers: Regret Bound and Exploration Complexity for Multi-Objective Reinforcement Learning
• Deep W-Networks: Solving Multi-Objective Optimisation Problems With Deep Reinforcement Learning
• Provably Efficient Cooperative Multi-Agent Reinforcement Learning with Function Approximation
• Review, Analysis and Design of a Comprehensive Deep Reinforcement Learning Framework
• Towards Content Provider Aware Recommender Systems: A Simulation Study on the Interplay between User and Provider Utilities
• Learning Controllable Content Generators
• Using Logical Specifications of Objectives in Multi-Objective Reinforcement Learning
• Choosing the Best of Both Worlds: Diverse and Novel Recommendations through Multi-Objective Reinforcement Learning