5 citations · 6 across the 17 of their papers we have counts for
18 papers
World Action Critic (WAC) Model: Joint Foresight and Criticism for Policy Learning
Xiangteng Zhang, Haoyuan Liu, Yang Guan +7
World models have shown considerable promise in sequential decision-making by anticipating the consequences of actions and providing predictive foresight for policy learning. Howev…
Momentum as Residual-Driven Multiplier Correction for Deep Learning Optimization
Zhixin Ren, Yao Lyu, Congrong Li +2
Momentum-based optimizers are widely used in modern deep learning, yet the relations among momentum recursion, update geometry, and acceleration remain only partially understood. W…
Distributional Soft Bellman Operator under the Cramér Geometry
Keru Wang, Yixin Deng, Yao Lyu +2
Distributional soft policy iteration (DSPI) provides an important framework for combining distributional reinforcement learning (DRL) with maximum-entropy control, in which the pol…
M3imic: Learning a Versatile Whole-Body Controller for Multimodal Motion Mimicking
Zuxing Lu, Ziang Zheng, Yao Lyu +7
Building a general-purpose whole-body controller is essential for enabling diverse motion capabilities in humanoid robots across a wide range of downstream tasks, including locomot…
FUSE: A Framework for Unified State Estimation in Vehicular and Robotic SLAM Systems
Wei Wu, Honglin Chen, Wenhan Cao +7
Tightly coupled SLAM formulations under mixed-rate sensing often bind temporal processing, local geometric association, estimator formulation, and map-update policy into method-spe…
Natural Gradient Bayesian Filtering: Geometry-Aware Filter for Dynamical Systems
Chang Liu, Wenhan Cao, Zeju Sun +8
Bayesian filtering is a cornerstone of state estimation in complex systems such as aerospace systems, yet exact solutions are available only for linear Gaussian models. In practice…
Augmented Lagrangian Multiplier Network for State-wise Safety in Reinforcement Learning
Jiaming Zhang, Yujie Yang, Yao Lyu +2
Safety is a primary challenge in real-world reinforcement learning (RL). Formulating safety requirements as state-wise constraints has become a prominent paradigm. Handling state-w…
Natural Gradient Gaussian Approximation Filter on Lie Groups for Robot State Estimation
Tianyi Zhang, Wenhan Cao, Chang Liu +2
Accurate state estimation for robotic systems evolving on Lie group manifolds, such as legged robots, is a prerequisite for achieving agile control. However, this task is challenge…
A Spectral Revisit of the Distributional Bellman Operator under the Cramér Metric
Keru Wang, Yixin Deng, Yao Lyu +2
Distributional reinforcement learning (DRL) studies the evolution of full return distributions under Bellman updates rather than focusing on expected values. A classical result is…
Real-Time Generative Policy via Langevin-Guided Flow Matching for Autonomous Driving
Tianze Zhu, Yinuo Wang, Wenjun Zou +6
Reinforcement learning (RL) is a fundamental methodology in autonomous driving systems, where generative policies exhibit considerable potential by leveraging their ability to mode…
Jump-Start Reinforcement Learning with Self-Evolving Priors for Extreme Monopedal Locomotion
Ziang Zheng, Guojian Zhan, Shiqi Liu +3
Reinforcement learning (RL) has shown great potential in enabling quadruped robots to perform agile locomotion. However, directly training policies to simultaneously handle dual ex…
Predictive Lagrangian Optimization for Constrained Reinforcement Learning
Tianqi Zhang, Puzhen Yuan, Guojian Zhan +6
Constrained optimization is popularly seen in reinforcement learning for addressing complex control tasks. From the perspective of dynamic system, iteratively solving a constrained…
Conformal Symplectic Optimization for Stable Reinforcement Learning
Yao Lyu, Xiangteng Zhang, Shengbo Eben Li +5
Training deep reinforcement learning (RL) agents necessitates overcoming the highly unstable nonconvex stochastic optimization inherent in the trial-and-error mechanism. To tackle…
Policy Bifurcation in Safe Reinforcement Learning
Wenjun Zou, Yao Lyu, Jie Li +7
Safe reinforcement learning (RL) offers advanced solutions to constrained optimal control problems. Existing studies in safe RL implicitly assume continuity in policy functions, wh…
Bridging the Gap between Newton-Raphson Method and Regularized Policy Iteration
Zeyang Li, Chuxiong Hu, Yunan Wang +4
Regularization is a cornerstone of modern reinforcement learning. Regularized policy iteration (RPI) provides a fundamental scheme for solving regularized Markov decision processes…
Smoothing Policy Iteration for Zero-sum Markov Games
Yangang Ren, Yao Lyu, Wenxuan Wang +3
Zero-sum Markov Games (MGs) has been an efficient framework for multi-agent systems and robust control, wherein a minimax problem is constructed to solve the equilibrium policies.…
Quantifying the Individual Differences of Driver' Risk Perception with Just Four Interpretable Parameters
Chen Chen, Zhiqian Lan, Guojian Zhan +3
There will be a long time when automated vehicles are mixed with human-driven vehicles. Understanding how drivers assess driving risks and modelling their individual differences ar…
Zeroth-Order Actor-Critic: An Evolutionary Framework for Sequential Decision Problems
Yuheng Lei, Yao Lyu, Guojian Zhan +5
Evolutionary algorithms (EAs) have shown promise in solving sequential decision problems (SDPs) by simplifying them to static optimization problems and searching for the optimal po…