activity
20222026
most citedGoSafeOpt: Scalable Safe Exploration for Global Optimization of Dynamical Systems

12 citations · 18 across the 21 of their papers we have counts for

collaborators

23 papers

cs.RO2026

Tactile Curiosity Drives Robot Interaction

Klemens Iten, Alexander Proshkin, Bhavya Sukhija +4

Mastering robot manipulation skills via reinforcement learning (RL) remains largely sample-inefficient. The most common RL algorithms rely on random action sampling to discover new…

cs.AI2026

EXIMO: VLM Guided Exploration of VLA Policies

Bhavya Sukhija, Oliver Groth, Mohit Shridhar +5

How to efficiently finetune robot policies to learn new tasks on the fly? State of the art robotic manipulation policies are based on behaviour cloning of large vision-language-act…

cs.LG2026

Model-Based Reinforcement Learning for Control under Time-Varying Dynamics

Klemens Iten, Bruce Lee, Chenhao Li +3

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions.…

cs.LG2025

SOMBRL: Scalable and Optimistic Model-Based RL

Bhavya Sukhija, Lenart Treven, Carmelo Sferrazza +3

We address the challenge of efficient exploration in model-based reinforcement learning (MBRL), where the system dynamics are unknown and the RL agent must learn directly from onli…

cs.RO2025

Learning Soft Robotic Dynamics with Active Exploration

Hehui Zheng, Bhavya Sukhija, Chenhao Li +3

Soft robots offer unmatched adaptability and safety in unstructured environments, yet their compliant, high-dimensional, and nonlinear dynamics make modeling for control notoriousl…

cs.LG2025

Sample-efficient and Scalable Exploration in Continuous-Time RL

Klemens Iten, Lenart Treven, Bhavya Sukhija +2

Reinforcement learning algorithms are typically designed for discrete-time dynamics, even though the underlying real-world control systems are often continuous in time. In this pap…

cs.LG2025

Simulation Priors for Data-Efficient Deep Learning

Lenart Treven, Bhavya Sukhija, Jonas Rothfuss +3

How do we enable AI systems to efficiently learn in the real-world? First-principles models are widely used to simulate natural systems, but often fail to capture real-world comple…

cs.LG2024★ 1 cited

MaxInfoRL: Boosting exploration in reinforcement learning through information gain maximization

Bhavya Sukhija, Stelian Coros, Andreas Krause +2

Reinforcement learning (RL) algorithms aim to balance exploiting the current best strategy with exploring new options that could lead to higher rewards. Most common RL algorithms u…

cs.LG2024

ActSafe: Active Exploration with Safety Constraints for Reinforcement Learning

Yarden As, Bhavya Sukhija, Lenart Treven +3

Reinforcement learning (RL) is ubiquitous in the development of modern AI systems. However, state-of-the-art RL agents require extensive, and potentially unsafe, interactions with…

cs.RO2024★ 1 cited

MetaLoco: Universal Quadrupedal Locomotion with Meta-Reinforcement Learning and Motion Imitation

Fatemeh Zargarbashi, Fabrizio Di Giuro, Jin Cheng +3

This work presents a meta-reinforcement learning approach to develop a universal locomotion control policy capable of zero-shot generalization across diverse quadrupedal platforms.…

cs.LG2024

NeoRL: Efficient Exploration for Nonepisodic RL

Bhavya Sukhija, Lenart Treven, Florian Dörfler +2

We study the problem of nonepisodic reinforcement learning (RL) for nonlinear dynamical systems, where the system dynamics are unknown and the RL agent has to learn from a single t…

cs.LG2024

When to Sense and Control? A Time-adaptive Approach for Continuous-Time RL

Lenart Treven, Bhavya Sukhija, Yarden As +2

Reinforcement learning (RL) excels in optimizing policies for discrete-time Markov decision processes (MDP). However, various systems are inherently continuous in time, making disc…

cs.LG2024★ 1 cited

Safe Exploration Using Bayesian World Models and Log-Barrier Optimization

Yarden As, Bhavya Sukhija, Andreas Krause

A major challenge in deploying reinforcement learning in online tasks is ensuring that safety is maintained throughout the learning process. In this work, we propose CERL, a new me…

cs.RO2024★ 1 cited

Bridging the Sim-to-Real Gap with Bayesian Inference

Jonas Rothfuss, Bhavya Sukhija, Lenart Treven +3

We present SIM-FSVGD for learning robot dynamics from data. As opposed to traditional methods, SIM-FSVGD leverages low-fidelity physical priors, e.g., in the form of simulators, to…

cs.LG2024

Transductive Active Learning: Theory and Applications

Jonas Hübotter, Bhavya Sukhija, Lenart Treven +2

We study a generalization of classical active learning to real-world settings with concrete prediction targets where sampling is restricted to an accessible region of the domain, w…

cs.LG2024

Active Few-Shot Fine-Tuning

Jonas Hübotter, Bhavya Sukhija, Lenart Treven +2

We study the question: How can we select the right data for fine-tuning to a specific task? We call this data selection problem active fine-tuning and show that it is an instance o…

cs.LG2023

Data-Efficient Task Generalization via Probabilistic Model-based Meta Reinforcement Learning

Arjun Bhardwaj, Jonas Rothfuss, Bhavya Sukhija +4

We introduce PACOH-RL, a novel model-based Meta-Reinforcement Learning (Meta-RL) algorithm designed to efficiently adapt control policies to changing dynamics. PACOH-RL meta-learns…

cs.LG2023

Efficient Exploration in Continuous-time Model-based Reinforcement Learning

Lenart Treven, Jonas Hübotter, Bhavya Sukhija +2

Reinforcement learning algorithms typically consider discrete-time dynamics, even though the underlying systems are often continuous in time. In this paper, we introduce a model-ba…

cs.LG2023★ 1 cited

Optimistic Active Exploration of Dynamical Systems

Bhavya Sukhija, Lenart Treven, Cansu Sancaktar +3

Reinforcement learning algorithms commonly seek to optimize policies for solving one particular task. How should we explore an unknown dynamical system such that the estimated mode…

cs.RO2023★ 1 cited

Tuning Legged Locomotion Controllers via Safe Bayesian Optimization

Daniel Widmer, Dongho Kang, Bhavya Sukhija +3

This paper presents a data-driven strategy to streamline the deployment of model-based controllers in legged robotic hardware platforms. Our approach leverages a model-free safe le…

cs.LG2023

Hallucinated Adversarial Control for Conservative Offline Policy Evaluation

Jonas Rothfuss, Bhavya Sukhija, Tobias Birchler +2

We study the problem of conservative off-policy evaluation (COPE) where given an offline dataset of environment interactions, collected by other agents, we seek to obtain a (tight)…

cs.RO2022

Gradient-Based Trajectory Optimization With Learned Dynamics

Bhavya Sukhija, Nathanael Köhler, Miguel Zamora +4

Trajectory optimization methods have achieved an exceptional level of performance on real-world robots in recent years. These methods heavily rely on accurate analytical models of…

cs.LG2022★ 12 cited

GoSafeOpt: Scalable Safe Exploration for Global Optimization of Dynamical Systems

Bhavya Sukhija, Matteo Turchetta, David Lindner +3

Learning optimal control policies directly on physical systems is challenging since even a single failure can lead to costly hardware damage. Most existing model-free learning meth…