activity
20232026
most citedNatural and Robust Walking using Reinforcement Learning without Demonstrations in High-Dimensional Musculoskeletal Models

10 citations · 22 across the 21 of their papers we have counts for

collaborators

21 papers

cs.RO2026

Belt-Finger: An Affordable Soft Belt-Driven Gripper for Dexterous In-Hand Manipulation

Boya Zhang, Andreas Zell, Georg Martius

Parallel-jaw grippers are the default manipulator choice in robotics because they are simple, robust, and inexpensive. Their limited in-hand mobility, however, often forces large a…

cs.RO2026

LoComposition: Terrain-Adaptive Energy-Efficient Quadruped Locomotion without Gait Priors

Loukas Kordos, Leonard T. Franz, Simon Rappenecker +4

Learning-based quadrupedal locomotion typically relies on complex reward formulations that entangle task specification, operational limits, gait preference, and terrain adaptation…

cs.RO2026

Novel Algorithms for Smoothly Differentiable and Efficiently Vectorizable Contact Manifold Construction

Onur Beker, Andreas René Geist, Anselm Paulus +1

Generating intelligent robot behavior in contact-rich settings is a research problem where zeroth-order methods currently prevail. Developing methods that make use of first/second…

cs.LG2026

SoftJAX & SoftTorch: Empowering Automatic Differentiation Libraries with Informative Gradients

Anselm Paulus, A. René Geist, Vít Musil +3

Automatic differentiation (AD) frameworks such as JAX and PyTorch have enabled gradient-based optimization for a wide range of scientific fields. Yet, many "hard" primitives in the…

cs.RO2026

Smoothly Differentiable and Efficiently Vectorizable Contact Manifold Generation

Onur Beker, Andreas René Geist, Anselm Paulus +4

Simulating rigid-body dynamics with contact in a fast, massively vectorizable, and smoothly differentiable manner is highly desirable in robotics. An important bottleneck faced by…

cs.LG2026

Stochastic Decision Horizons for Survival-Based Constrained Reinforcement Learning

Nikola Milosevic, Leonard Franz, Daniel Haeufle +3

We propose stochastic decision horizons (SDH), a theoretically grounded framework for survival-based constrained reinforcement learning from per-step violation signals. Rather than…

cs.LG2025

Epistemically-guided forward-backward exploration

Núria Armengol Urpí, Marin Vlastelica, Georg Martius +1

Zero-shot reinforcement learning is necessary for extracting optimal policies in absence of concrete rewards for fast adaptation to future problem settings. Forward-backward repres…

cs.RO2025

Differentiable Simulation of Hard Contacts with Soft Gradients for Learning and Control

Anselm Paulus, A. René Geist, Pierre Schumacher +3

Contact forces introduce discontinuities into robot dynamics that severely limit the use of simulators for gradient-based optimization. Penalty-based simulators such as MuJoCo, sof…

cs.GR2025

Learning 3D-Gaussian Simulators from RGB Videos

Mikel Zhobro, Andreas René Geist, Georg Martius

Realistic simulation is critical for applications ranging from robotics to animation. Learned simulators have emerged as a possibility to capture real world physics directly from v…

cs.RO2025

The Role of Tactile Sensing for Learning Reach and Grasp

Boya Zhang, Iris Andrussow, Andreas Zell +1

Stable and robust robotic grasping is essential for current and future robot applications. In recent works, the use of large datasets and supervised learning has enhanced speed and…

cs.LG2025

Dual-Force: Enhanced Offline Diversity Maximization under Imitation Constraints

Pavel Kolev, Marin Vlastelica, Georg Martius

Offline diversity maximization under imitation constraints can transform demonstration data into a set of distinct behavioral policies, improving robustness to distribution shift w…

cs.RO2024

Identifying Terrain Physical Parameters from Vision -- Towards Physical-Parameter-Aware Locomotion and Navigation

Jiaqi Chen, Jonas Frey, Ruyi Zhou +3

Identifying the physical properties of the surrounding environment is essential for robotic locomotion and navigation to deal with non-geometric hazards, such as slippery and defor…

cs.LG2024

LPGD: A General Framework for Backpropagation through Embedded Optimization Layers

Anselm Paulus, Georg Martius, Vít Musil

Embedding parameterized optimization problems as layers into machine learning architectures serves as a powerful inductive bias. Training such architectures with stochastic gradien…

cs.LG2024

Causal Action Influence Aware Counterfactual Data Augmentation

Núria Armengol Urpí, Marco Bagatella, Marin Vlastelica +1

Offline data are both valuable and practical resources for teaching robots complex behaviors. Ideally, learning agents should not be constrained by the scarcity of available demons…

cs.RO2024★ 2 cited

Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervision

Matías Mattamala, Jonas Frey, Piotr Libera +5

Natural environments such as forests and grasslands are challenging for robotic navigation because of the false perception of rigid obstacles from high grass, twigs, or bushes. In…

cs.LG2024★ 3 cited

Learning with 3D rotations, a hitchhiker's guide to SO(3)

A. René Geist, Jonas Frey, Mikel Zhobro +2

Many settings in machine learning require the selection of a rotation representation. However, choosing a suitable representation from the many available options is challenging. Th…

cs.RO2024

Learning to Control Emulated Muscles in Real Robots: Towards Exploiting Bio-Inspired Actuator Morphology

Pierre Schumacher, Lorenz Krause, Jan Schneider +3

Recent studies have demonstrated the immense potential of exploiting muscle actuator morphology for natural and robust movement -- in simulation. A validation on real robotic hardw…

cs.LG2023★ 6 cited

Multi-View Causal Representation Learning with Partial Observability

Dingling Yao, Danru Xu, Sébastien Lachapelle +5

We present a unified framework for studying the identifiability of representations learned from simultaneously observed views, such as different data modalities. We allow a partial…

cs.RO2023★ 10 cited

Natural and Robust Walking using Reinforcement Learning without Demonstrations in High-Dimensional Musculoskeletal Models

Pierre Schumacher, Thomas Geijtenbeek, Vittorio Caggiano +4

Humans excel at robust bipedal walking in complex natural environments. In each step, they adequately tune the interaction of biomechanical muscle dynamics and neuronal signals to…

cs.NE2023★ 1 cited

Emergent mechanisms for long timescales depend on training curriculum and affect performance in memory tasks

Sina Khajehabdollahi, Roxana Zeraati, Emmanouil Giannakakis +3

Recurrent neural networks (RNNs) in the brain and in silico excel at solving tasks with intricate temporal dependencies. Long timescales required for solving such tasks can arise f…

cs.LG2023

Offline Diversity Maximization Under Imitation Constraints

Marin Vlastelica, Jin Cheng, Georg Martius +1

There has been significant recent progress in the area of unsupervised skill discovery, utilizing various information-theoretic objectives as measures of diversity. Despite these a…