4 papers
SIL: Symbiotic Interactive Learning for Language-Conditioned Human-Agent Co-Adaptation
Linus Nwankwo, Bjoern Ellensohn, Christian Rauch +1
Today's autonomous agents, largely driven by foundation models (FMs), can understand natural language instructions and solve long-horizon tasks with human-like reasoning. However,…
Real-Time 3D Vision-Language Embedding Mapping
Christian Rauch, Björn Ellensohn, Linus Nwankwo +2
A metric-accurate semantic 3D representation is essential for many robotic tasks. This work proposes a simple, yet powerful, way to integrate the 2D embeddings of a Vision-Language…
ReLI: Cross-Lingual Language-to-Action Grounding for Human-Robot Interaction
Linus Nwankwo, Bjoern Ellensohn, Ozan Özdenizci +1
Adapting autonomous agents for real-world industrial, domestic, and other daily tasks is currently gaining momentum. However, in global or cross-lingual application contexts, the a…
EnvoDat: A Large-Scale Multisensory Dataset for Robotic Spatial Awareness and Semantic Reasoning in Heterogeneous Environments
Linus Nwankwo, Bjoern Ellensohn, Vedant Dave +5
To ensure the efficiency of robot autonomy under diverse real-world conditions, a high-quality heterogeneous dataset is essential to benchmark the operating algorithms' performance…