activity
20242026
most citedLeveraging Vision-Language Models for Open-Vocabulary Instance Segmentation and Tracking

2 citations · 3 across the 16 of their papers we have counts for

collaborators

16 papers

cs.RO2026

Benchmarking Robots for Everyday Environments: From Lab Experiments to Real-World Operations

Raphael Memmesheimer, Martina Overbeck, Dominik Beyer +20

This study presents an interdisciplinary process for benchmarking service robots in public everyday environments, addressing the gap between laboratory metrics and real-world opera…

cs.RO2026

Sample, Simulate, Select: Physics-in-the-Loop Text-to-Motion for Humanoids Without Training

Raphael Memmesheimer, Sven Behnke

Text-to-motion models generate plausible human motion but do not model a robot's dynamics; whole-body tracking controllers execute robot references reliably but cannot replan an in…

cs.RO2026

ContactFlow: A video action conditioning that transfers across embodiments

Sami Azirar, Enrico Pallotta, Jan Nogga +3

World models offer a promising route toward robot planning by enabling agents to imagine and verify the consequences of actions before execution. However, current video-based world…

cs.CV2026

Efficient Image Annotation via Semi-Supervised Object Segmentation with Label Propagation

Vitalii Tutevych, Raphael Memmesheimer, Luca Eichler +4

Reliable object perception is necessary for general-purpose service robots. Open-vocabulary detectors struggle to generalize beyond a few classes and fully supervised training of o…

cs.RO2025

OMCL: Open-vocabulary Monte Carlo Localization

Evgenii Kruzhkov, Raphael Memmesheimer, Sven Behnke

Robust robot localization is an important prerequisite for navigation, but it becomes challenging when the map and robot measurements are obtained from different sensors. Prior met…

cs.RO2025

EL3DD: Extended Latent 3D Diffusion for Language Conditioned Multitask Manipulation

Jonas Bode, Raphael Memmesheimer, Sven Behnke

Acting in human environments is a crucial capability for general-purpose robots, necessitating a robust understanding of natural language and its application to physical tasks. Thi…

cs.RO2025

Integration of the TIAGo Robot into Isaac Sim with Mecanum Drive Modeling and Learned S-Curve Velocity Profiles

Vincent Schoenbach, Marvin Wiedemann, Raphael Memmesheimer +2

Efficient physics simulation has significantly accelerated research progress in robotics applications such as grasping and assembly. The advent of GPU-accelerated simulation framew…

cs.CV2025★ 2 cited

Leveraging Vision-Language Models for Open-Vocabulary Instance Segmentation and Tracking

Bastian Pätzold, Jan Nogga, Sven Behnke

Vision-language models (VLMs) excel in visual understanding but often lack reliable grounding capabilities and actionable inference rates. Integrating them with open-vocabulary obj…

cs.CV2025

LIAM: Multimodal Transformer for Language Instructions, Images, Actions and Semantic Maps

Yihao Wang, Raphael Memmesheimer, Sven Behnke

The availability of large language models and open-vocabulary object perception methods enables more flexibility for domestic service robots. The large variability of domestic task…

cs.RO2024★ 1 cited

RoboCup@Home 2024 OPL Winner NimbRo: Anthropomorphic Service Robots using Foundation Models for Perception and Planning

Raphael Memmesheimer, Jan Nogga, Bastian Pätzold +8

We present the approaches and contributions of the winning team NimbRo@Home at the RoboCup@Home 2024 competition in the Open Platform League held in Eindhoven, NL. Further, we desc…

cs.CV2024

Person Segmentation and Action Classification for Multi-Channel Hemisphere Field of View LiDAR Sensors

Svetlana Seliunina, Artem Otelepko, Raphael Memmesheimer +1

Robots need to perceive persons in their surroundings for safety and to interact with them. In this paper, we present a person segmentation and action classification approach that…

cs.CV2024

Marker-free Human Gait Analysis using a Smart Edge Sensor System

Eva Katharina Bauer, Simon Bultmann, Sven Behnke

The human gait is a complex interplay between the neuronal and the muscular systems, reflecting an individual's neurological and physiological condition. This makes gait analysis a…

cs.RO2024

A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service Robotics

Jonas Bode, Bastian Pätzold, Raphael Memmesheimer +1

Recent advances in LLM have been instrumental in autonomous robot control and human-robot interaction by leveraging their vast general knowledge and capabilities to understand and…

cs.RO2024

Anticipating Human Behavior for Safe Navigation and Efficient Collaborative Manipulation with Mobile Service Robots

Simon Bultmann, Raphael Memmesheimer, Jan Nogga +2

The anticipation of human behavior is a crucial capability for robots to interact with humans safely and efficiently. We employ a smart edge sensor network to provide global observ…

cs.RO2024

Self-Centering 3-DoF Feet Controller for Hands-Free Locomotion Control in Telepresence and Virtual Reality

Raphael Memmesheimer, Christian Lenz, Max Schwarz +2

We present a novel seated feet controller for handling 3-DoF aimed to control locomotion for telepresence robotics and virtual reality environments. Tilting the feet on two axes yi…

cs.RO2024

Cleaning Robots in Public Spaces: A Survey and Proposal for Benchmarking Based on Stakeholders Interviews

Raphael Memmesheimer, Martina Overbeck, Bjoern Kral +4

Autonomous cleaning robots for public spaces have potential for addressing current societal challenges, such as labor shortages and cleanliness in public spaces. Other application…