4 papers · 1 filter
Hierarchical Time-aware Bootstrapping for Off-Policy Subgoal Value Learning
Bingyun Liu, Yuheng Jing
Off-policy hierarchical reinforcement learning must estimate the values of high-level decisions while the low-level policy changes. HIRO adapts replay data through subgoal relabeli…
On Semi-Markov Suboptimality in Hierarchical Reinforcement Learning
Bingyun Liu, Yuheng Jing
Hierarchical reinforcement learning uses temporally extended subtasks for exploration, yet committing to their execution can restrict both deployment and policy learning. We identi…
When Do Options Help? Policy Necrosis and Redundant Coverage in Option-Critic
Bingyun Liu, Yuheng Jing
Option-critic learns options: sub-policies together with a learned rule for when each one hands control back. Its headline result is that performance improves as options are added.…
Minimizing Weighted Counterfactual Regret with Optimistic Online Mirror Descent
Hang Xu, Kai Li, Bingyun Liu +4
Counterfactual regret minimization (CFR) is a family of algorithms for effectively solving imperfect-information games. It decomposes the total regret into counterfactual regrets,…