11 citations · 18 across the 18 of their papers we have counts for
19 papers
Sampling-Based Safe Reinforcement Learning
Luca Vignola, Bruce D. Lee, Manish Prajapat +4
Safe exploration remains a fundamental challenge in reinforcement learning (RL), limiting the deployment of RL agents in the real world. We propose Sampling-Based Safe Reinforcemen…
When Does Non-Uniform Replay Matter in Reinforcement Learning?
Michal Korniak, Mikołaj Czarnecki, Yarden As +3
Modern off-policy reinforcement learning algorithms often rely on simple uniform replay sampling and it remains unclear when and why non-uniform replay improves over this strong ba…
What Matters for Simulation to Online Reinforcement Learning on Real Robots
Yarden As, Dhruva Tirumala, René Zurbrügg +4
We investigate what specific design choices enable successful online reinforcement learning (RL) on physical robots. Across 100 real-world training runs on three distinct robotic p…
Safe Exploration via Policy Priors
Manuel Wendl, Yarden As, Manish Prajapat +3
Safe exploration is a key requirement for reinforcement learning (RL) agents to learn and adapt online, beyond controlled (e.g. simulated) environments. In this work, we tackle thi…
SPiDR: A Simple Approach for Zero-Shot Safety in Sim-to-Real Transfer
Yarden As, Chengrui Qu, Benjamin Unger +6
Deploying reinforcement learning (RL) safely in the real world is challenging, as policies trained in simulators must face the inevitable sim-to-real gap. Robust safe RL techniques…
Robust-Sub-Gaussian Model Predictive Control for Safe Ultrasound-Image-Guided Robotic Spinal Surgery
Yunke Ao, Manish Prajapat, Yarden As +6
Safety-critical control using high-dimensional sensory feedback from optical data (e.g., images, point clouds) poses significant challenges in domains like autonomous driving and r…
Learning Safety Constraints for Large Language Models
Xin Chen, Yarden As, Andreas Krause
Large language models (LLMs) have emerged as powerful tools but pose significant safety risks through harmful outputs and vulnerability to adversarial attacks. We propose SaP, shor…
Safe-EF: Error Feedback for Nonsmooth Constrained Optimization
Rustem Islamov, Yarden As, Ilyas Fatkhullin
Federated learning faces severe communication bottlenecks due to the high dimensionality of model updates. Communication compression with contractive compressors (e.g., Top-K) is o…
Stochastic Model Predictive Control for Sub-Gaussian Noise
Yunke Ao, Johannes Köhler, Manish Prajapat +4
We propose a stochastic Model Predictive Control (MPC) framework that ensures closed-loop chance constraint satisfaction for linear systems with general sub-Gaussian process and me…
Symmetry-Guided Memory Augmentation for Efficient Locomotion Learning
Kaixi Bao, Chenhao Li, Yarden As +2
Training reinforcement learning (RL) policies for legged locomotion often requires extensive environment interactions, which are costly and time-consuming. We propose Symmetry-Guid…
ActSafe: Active Exploration with Safety Constraints for Reinforcement Learning
Yarden As, Bhavya Sukhija, Lenart Treven +3
Reinforcement learning (RL) is ubiquitous in the development of modern AI systems. However, state-of-the-art RL agents require extensive, and potentially unsafe, interactions with…
When to Sense and Control? A Time-adaptive Approach for Continuous-Time RL
Lenart Treven, Bhavya Sukhija, Yarden As +2
Reinforcement learning (RL) excels in optimizing policies for discrete-time Markov decision processes (MDP). However, various systems are inherently continuous in time, making disc…
Safe Exploration Using Bayesian World Models and Log-Barrier Optimization
Yarden As, Bhavya Sukhija, Andreas Krause
A major challenge in deploying reinforcement learning in online tasks is ensuring that safety is maintained throughout the learning process. In this work, we propose CERL, a new me…
Transductive Active Learning: Theory and Applications
Jonas Hübotter, Bhavya Sukhija, Lenart Treven +2
We study a generalization of classical active learning to real-world settings with concrete prediction targets where sampling is restricted to an accessible region of the domain, w…
Active Few-Shot Fine-Tuning
Jonas Hübotter, Bhavya Sukhija, Lenart Treven +2
We study the question: How can we select the right data for fine-tuning to a specific task? We call this data selection problem active fine-tuning and show that it is an instance o…
Data-Efficient Task Generalization via Probabilistic Model-based Meta Reinforcement Learning
Arjun Bhardwaj, Jonas Rothfuss, Bhavya Sukhija +4
We introduce PACOH-RL, a novel model-based Meta-Reinforcement Learning (Meta-RL) algorithm designed to efficiently adapt control policies to changing dynamics. PACOH-RL meta-learns…
Safe Deep RL for Intraoperative Planning of Pedicle Screw Placement
Yunke Ao, Hooman Esfandiari, Fabio Carrillo +5
Spinal fusion surgery requires highly accurate implantation of pedicle screw implants, which must be conducted in critical proximity to vital structures with a limited view of anat…
Log Barriers for Safe Black-box Optimization with Application to Safe Reinforcement Learning
Ilnura Usmanova, Yarden As, Maryam Kamgarpour +1
Optimizing noisy functions online, when evaluating the objective requires experiments on a deployed system, is a crucial task arising in manufacturing, robotics and many others. Of…
Constrained Policy Optimization via Bayesian World Models
Yarden As, Ilnura Usmanova, Sebastian Curi +1
Improving sample-efficiency and safety are crucial challenges when deploying reinforcement learning in high-stakes real world applications. We propose LAMBDA, a novel model-based a…