5 papers
Momentum as Residual-Driven Multiplier Correction for Deep Learning Optimization
Zhixin Ren, Yau Lyu, Congrong Li +2
Momentum-based optimizers are widely used in modern deep learning, yet the relations among momentum recursion, update geometry, and acceleration remain only partially understood. W…
Augmented Lagrangian Multiplier Network for State-wise Safety in Reinforcement Learning
Jiaming Zhang, Yujie Yang, Yao Lyu +2
Safety is a primary challenge in real-world reinforcement learning (RL). Formulating safety requirements as state-wise constraints has become a prominent paradigm. Handling state-w…
On the Optimization Landscape of Observer-based Dynamic Linear Quadratic Control
Jingliang Duan, Jie Li, Yinsong Ma +5
Understanding the optimization landscape of linear quadratic regulation (LQR) problems is fundamental to the design of efficient reinforcement learning solutions. Recent work has m…
Exchange Policy Optimization Algorithm for Semi-Infinite Safe Reinforcement Learning
Jiaming Zhang, Yujie Yang, Haoning Wang +2
Safe reinforcement learning (safe RL) aims to respect safety requirements while optimizing long-term performance. In many practical applications, however, the problem involves an i…
Predictive Lagrangian Optimization for Constrained Reinforcement Learning
Tianqi Zhang, Puzhen Yuan, Guojian Zhan +6
Constrained optimization is popularly seen in reinforcement learning for addressing complex control tasks. From the perspective of dynamic system, iteratively solving a constrained…