4 papers
Hierarchical Time-aware Bootstrapping for Off-Policy Subgoal Value Learning
Bingyun Liu, Yuheng Jing
Off-policy hierarchical reinforcement learning must estimate the values of high-level decisions while the low-level policy changes. HIRO adapts replay data through subgoal relabeli…
On Semi-Markov Suboptimality in Hierarchical Reinforcement Learning
Bingyun Liu, Yuheng Jing
Hierarchical reinforcement learning uses temporally extended subtasks for exploration, yet committing to their execution can restrict both deployment and policy learning. We identi…
When Do Options Help? Policy Necrosis and Redundant Coverage in Option-Critic
Bingyun Liu, Yuheng Jing
Option-critic learns options: sub-policies together with a learned rule for when each one hands control back. Its headline result is that performance improves as options are added.…
Hi-Agent: Hierarchical Vision-Language Agents for Mobile Device Control
Zhe Wu, Hongjin Lu, Junliang Xing +10
Building agents that autonomously operate mobile devices has attracted increasing attention. While Vision-Language Models (VLMs) show promise, most existing approaches rely on dire…