6 papers · 1 filter
ROAD-VLA: Robust Online Adaptation via Self-Distillation for Vision-Language-Action Models
Kejing Wang, Toan Nguyen, Minh Hoang Nguyen +2
Effective online adaptation of vision-language-action (VLA) models remains challenging, as sparse rewards provide weak supervision for high-dimensional autoregressive action polici…
Experience Constrained Hierarchical Federated Reinforcement Learning for Large-scale UAV Teams in Hazardous Environments
Qinwei Huang, Rui Zuo, Simon Khan +1
Conventional federated learning assumes that greater learner participation improves training performance, by leveraging abundant, independently generated local data. However, in fe…
Criticality and Safety Margins for Reinforcement Learning
Alexander Grushin, Walt Woods, Alvaro Velasquez +1
State of the art reinforcement learning methods sometimes encounter unsafe situations. Identifying when these situations occur is of interest both for post-hoc analysis and during…
Near-Optimal Sample Complexity for Iterated CVaR Reinforcement Learning with a Generative Model
Zilong Deng, Simon Khan, Shaofeng Zou
In this work, we study the sample complexity problem of risk-sensitive Reinforcement Learning (RL) with a generative model, where we aim to maximize the Conditional Value at Risk (…
Combining AI Control Systems and Human Decision Support via Robustness and Criticality
Walt Woods, Alexander Grushin, Simon Khan +1
AI-enabled capabilities are reaching the requisite level of maturity to be deployed in the real world, yet do not always make correct or safe decisions. One way of addressing these…
Safety Margins for Reinforcement Learning
Alexander Grushin, Walt Woods, Alvaro Velasquez +1
Any autonomous controller will be unsafe in some situations. The ability to quantitatively identify when these unsafe situations are about to occur is crucial for drawing timely hu…