177 citations · 995 across the 65 of their papers we have counts for
31 papers · 1 filter
T3S: Improving Multi-Task Reinforcement Learning with Task-Specific Feature Selector and Scheduler
Yuanqiang Yu, Tianpei Yang, Yongliang Lv +2
Multi-task reinforcement learning (MTRL) is a technique to train multiple tasks simultaneously, where previous works usually train a single model to solve different tasks by sharin…
Prioritized Trajectory Replay: A Replay Memory for Data-driven Reinforcement Learning
Jinyi Liu, Yi Ma, Jianye Hao +4
In recent years, data-driven reinforcement learning (RL), also known as offline RL, have gained significant attention. However, the role of data sampling techniques in offline RL h…
Plan To Predict: Learning an Uncertainty-Foreseeing Model for Model-Based Reinforcement Learning
Zifan Wu, Chao Yu, Chen Chen +2
In Model-based Reinforcement Learning (MBRL), model learning is critical since an inaccurate model can bias policy learning via generating misleading samples. However, learning an…
EUCLID: Towards Efficient Unsupervised Reinforcement Learning with Multi-choice Dynamics Model
Yifu Yuan, Jianye Hao, Fei Ni +6
Unsupervised reinforcement learning (URL) poses a promising paradigm to learn useful behaviors in a task-agnostic environment without the guidance of extrinsic rewards to facilitat…
Coach-assisted Multi-Agent Reinforcement Learning Framework for Unexpected Crashed Agents
Jian Zhao, Youpeng Zhao, Weixun Wang +5
Multi-agent reinforcement learning is difficult to be applied in practice, which is partially due to the gap between the simulated and real-world scenarios. One reason for the gap…
ED2: Environment Dynamics Decomposition World Models for Continuous Control
Jianye Hao, Yifu Yuan, Cong Wang +1
Model-based reinforcement learning (MBRL) achieves significant sample efficiency in practice in comparison to model-free RL, but its performance is often limited by the existence o…
Learning State Representations via Retracing in Reinforcement Learning
Changmin Yu, Dong Li, Jianye Hao +2
We propose learning via retracing, a novel self-supervised approach for learning the state representation (and the associated dynamics model) for reinforcement learning tasks. In a…
Dynamic Bottleneck for Robust Self-Supervised Exploration
Chenjia Bai, Lingxiao Wang, Lei Han +4
Exploration methods based on pseudo-count of transitions or curiosity of dynamics have achieved promising results in solving reinforcement learning with sparse rewards. However, su…
Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual Learning
Danruo Deng, Guangyong Chen, Jianye Hao +2
The backpropagation networks are notably susceptible to catastrophic forgetting, where networks tend to forget previously learned skills upon learning new ones. To address such the…
Contrastive ACE: Domain Generalization Through Alignment of Causal Mechanisms
Yunqi Wang, Furui Liu, Zhitang Chen +4
Domain generalization aims to learn knowledge invariant across different distributions while semantically meaningful for downstream tasks from multiple source domains, to improve t…
Principled Exploration via Optimistic Bootstrapping and Backward Induction
Chenjia Bai, Lingxiao Wang, Lei Han +4
One principled approach for provably efficient exploration is incorporating the upper confidence bound (UCB) into the value function as a bonus. However, UCB is specified to deal w…
Ordering-Based Causal Discovery with Reinforcement Learning
Xiaoqiang Wang, Yali Du, Shengyu Zhu +4
It is a long-standing question to discover causal relations among a set of variables in many empirical sciences. Recently, Reinforcement Learning (RL) has achieved promising result…
Addressing Action Oscillations through Learning Policy Inertia
Chen Chen, Hongyao Tang, Jianye Hao +2
Deep reinforcement learning (DRL) algorithms have been demonstrated to be effective in a wide range of challenging decision making and control tasks. However, these methods typical…
Foresee then Evaluate: Decomposing Value Estimation with Latent Future Prediction
Hongyao Tang, Jianye Hao, Guangyong Chen +6
Value function is the central notion of Reinforcement Learning (RL). Value estimation, especially with function approximation, can be challenging since it involves the stochasticit…
Critic PI2: Master Continuous Planning via Policy Improvement with Path Integrals and Deep Actor-Critic Reinforcement Learning
Jiajun Fan, He Ba, Xian Guo +1
Constructing agents with planning capabilities has long been one of the main challenges in the pursuit of artificial intelligence. Tree-based planning methods from AlphaGo to Muzer…
Learning to Utilize Shaping Rewards: A New Approach of Reward Shaping
Yujing Hu, Weixun Wang, Hangtian Jia +5
Reward shaping is an effective technique for incorporating domain knowledge into reinforcement learning (RL). Existing approaches such as potential-based reward shaping normally ma…
Dynamic Horizon Value Estimation for Model-based Reinforcement Learning
Junjie Wang, Qichao Zhang, Dongbin Zhao +2
Existing model-based value expansion methods typically leverage a world model for value estimation with a fixed rollout horizon to assist policy learning. However, the fixed rollou…
Towards Effective Context for Meta-Reinforcement Learning: an Approach based on Contrastive Learning
Haotian Fu, Hongyao Tang, Jianye Hao +4
Context, the embedding of previous collected trajectories, is a powerful construct for Meta-Reinforcement Learning (Meta-RL) algorithms. By conditioning on an effective context, Me…
Dynamic Knapsack Optimization Towards Efficient Multi-Channel Sequential Advertising
Xiaotian Hao, Zhaoqing Peng, Yi Ma +12
In E-commerce, advertising is essential for merchants to reach their target users. The typical objective is to maximize the advertiser's cumulative revenue over a period of time un…
Triple-GAIL: A Multi-Modal Imitation Learning Framework with Generative Adversarial Nets
Cong Fei, Bin Wang, Yuzheng Zhuang +5
Generative adversarial imitation learning (GAIL) has shown promising results by taking advantage of generative adversarial nets, especially in the field of robot learning. However,…
CausalVAE: Structured Causal Disentanglement in Variational Autoencoder
Mengyue Yang, Furui Liu, Zhitang Chen +3
Learning disentanglement aims at finding a low dimensional representation which consists of multiple explanatory and generative factors of the observational data. The framework of…
Efficient Deep Reinforcement Learning via Adaptive Policy Transfer
Tianpei Yang, Jianye Hao, Zhaopeng Meng +8
Transfer Learning (TL) has shown great potential to accelerate Reinforcement Learning (RL) by leveraging prior knowledge from past learned policies of relevant tasks. Existing tran…
There is Limited Correlation between Coverage and Robustness for Deep Neural Networks
Yizhen Dong, Peixin Zhang, Jingyi Wang +7
Deep neural networks (DNN) are increasingly applied in safety-critical systems, e.g., for face recognition, autonomous car control and malware detection. It is also shown that DNNs…
Diverse Behavior Is What Game AI Needs: Generating Varied Human-Like Playing Styles Using Evolutionary Multi-Objective Deep Reinforcement Learning
Ruimin Shen, Yan Zheng, Jianye Hao +2
this paper has been withdrawn