4 papers
ProDVI: Programmatic Dynamics Priors for Value Network Initialization
Xinwei Liu, Junyuan Liang, Jianting Zhang +1
Deep Reinforcement Learning (RL) is notoriously sample inefficient. One contributing factor is that RL agents are typically initialized from scratch, forcing them to acquire task-r…
Observation-Grounded Self-Predictive Reinforcement Learning for Visual Continuous Control
Xinwei Liu, Junyuan Liang, Jianting Zhang +1
Sample-efficient policy learning from pixels is a long-standing challenge in reinforcement learning (RL). Recent dynamics-based representation learning methods have significantly i…
NASDAQ: Normalized Observation Space Dynamics-Augmented Q-Learning
Xinwei Liu, Junyuan Liang, Zicong Hong +2
Augmenting model-free reinforcement learning (RL) with representations learned through observation dynamics prediction (observation-predictive RL) can improve sample efficiency and…
Krul: Efficient State Restoration for Multi-turn Conversations with Dynamic Cross-layer KV Sharing
Junyi Wen, Junyuan Liang, Zicong Hong +3
Efficient state restoration in multi-turn conversations with large language models (LLMs) remains a critical challenge, primarily due to the overhead of recomputing or loading full…