73 citations · 116 across the 9 of their papers we have counts for
10 papers
Fourier Features Let Agents Learn High Precision Policies with Imitation Learning
Balázs Gyenes, Emiliyan Gospodinov, Jan Frieling +5
High-precision robotic manipulation requires fine-grained spatial reasoning that is often difficult to achieve with RGB-only policies due to depth ambiguity and perspective scale i…
Point Cloud Segmentation for Autonomous Clip Positioning in Laparoscopic Cholecystectomy on a Phantom
Balázs Gyenes, Nikolai Franke, Paul Maria Scheikl +5
High-risk applications in robotics, such as robot-assisted surgery, present unique challenges. These systems must be both highly precise and interpretable in order to be deployed i…
Point Cloud Sequence Encoding for Material-conditioned Graph Network Simulators
Philipp Dahlinger, Balázs Gyenes, Niklas Freymuth +6
Graph Network Simulators (GNSs) have emerged as powerful surrogates for complex physics-based simulation, offering inherent differentiability and orders-of-magnitude speedups over…
PointMapPolicy: Structured Point Cloud Processing for Multi-Modal Imitation Learning
Xiaogang Jia, Qian Wang, Anrui Wang +12
Robotic manipulation systems benefit from complementary sensing modalities, where each provides unique environmental information. Point clouds capture detailed geometric structure,…
AMBER: Adaptive Mesh Generation by Iterative Mesh Resolution Prediction
Niklas Freymuth, Tobias Würth, Nicolas Schreiber +9
The cost and accuracy of simulating complex physical systems using the Finite Element Method (FEM) scales with the resolution of the underlying mesh. Adaptive meshes improve comput…
PointPatchRL -- Masked Reconstruction Improves Reinforcement Learning on Point Clouds
Balázs Gyenes, Nikolai Franke, Philipp Becker +1
Perceiving the environment via cameras is crucial for Reinforcement Learning (RL) in robotics. While images are a convenient form of representation, they often complicate extractin…
Sim-To-Real Transfer for Visual Reinforcement Learning of Deformable Object Manipulation for Robot-Assisted Surgery
Paul Maria Scheikl, Eleonora Tagliabue, Balázs Gyenes +4
Automation holds the potential to assist surgeons in robotic interventions, shifting their mental work load from visuomotor control to high level decision making. Reinforcement lea…
Registered and Segmented Deformable Object Reconstruction from a Single View Point Cloud
Pit Henrich, Balázs Gyenes, Paul Maria Scheikl +2
In deformable object manipulation, we often want to interact with specific segments of an object that are only defined in non-deformed models of the object. We thus require a syste…
LapGym -- An Open Source Framework for Reinforcement Learning in Robot-Assisted Laparoscopic Surgery
Paul Maria Scheikl, Balázs Gyenes, Rayan Younis +4
Recent advances in reinforcement learning (RL) have increased the promise of introducing cognitive assistance and automation to robot-assisted laparoscopic surgery (RALS). However,…
Cooperative Assistance in Robotic Surgery through Multi-Agent Reinforcement Learning
Paul Maria Scheikl, Balázs Gyenes, Tornike Davitashvili +6
Cognitive cooperative assistance in robot-assisted surgery holds the potential to increase quality of care in minimally invasive interventions. Automation of surgical tasks promise…