28 citations · 60 across the 14 of their papers we have counts for
15 papers
Feasibility of Augmented Reality-Guided Robotic Ultrasound with Cone-Beam CT Integration for Spine Procedures
Tianyu Song, Felix Pabst, Feng Li +5
Accurate needle placement in spine interventions is critical for effective pain management, yet it depends on reliable identification of anatomical landmarks and careful trajectory…
Comparative Study of Ultrasound Shape Completion and CBCT-Based AR Workflows for Spinal Needle Interventions
Tianyu Song, Feng Li, Felix Pabst +4
Purpose: This study compares two augmented reality (AR)-guided imaging workflows, one based on ultrasound shape completion and the other on cone-beam computed tomography (CBCT), fo…
Sonify Anything: Towards Context-Aware Sonic Interactions in AR
Laura Schütz, Sasan Matinfar, Ulrich Eck +2
In Augmented Reality (AR), virtual objects interact with real objects. However, the lack of physicality of virtual objects leads to the absence of natural sonic interactions. When…
Intelligent Virtual Sonographer (IVS): Enhancing Physician-Robot-Patient Communication
Tianyu Song, Feng Li, Yuan Bi +6
The advancement and maturity of large language models (LLMs) and robotics have unlocked vast potential for human-computer interaction, particularly in the field of robotic ultrasou…
MM-OR: A Large Multimodal Operating Room Dataset for Semantic Understanding of High-Intensity Surgical Environments
Ege Özsoy, Chantal Pellegrini, Tobias Czempiel +7
Operating rooms (ORs) are complex, high-stakes environments requiring precise understanding of interactions among medical staff, tools, and equipment for enhancing surgical assista…
Enhancing Patient Acceptance of Robotic Ultrasound through Conversational Virtual Agent and Immersive Visualizations
Tianyu Song, Felix Pabst, Ulrich Eck +1
Robotic ultrasound systems can enhance medical diagnostics, but patient acceptance is a challenge. We propose a system combining an AI-powered conversational virtual agent with thr…
Co-Designing Dynamic Mixed Reality Drill Positioning Widgets: A Collaborative Approach with Dentists in a Realistic Setup
Mine Dastan, Michele Fiorentino, Elias D. Walter +4
Mixed Reality (MR) is proven in the literature to support precise spatial dental drill positioning by superimposing 3D widgets. Despite this, the related knowledge about widget's v…
XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot
Jan Hendrik Plümer, Kevin Yu, Ulrich Eck +4
Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a…
A Framework for Multimodal Medical Image Interaction
Laura Schütz, Sasan Matinfar, Gideon Schafroth +6
Medical doctors rely on images of the human anatomy, such as magnetic resonance imaging (MRI), to localize regions of interest in the patient during diagnosis and treatment. Despit…
Complementary Textures. A Novel Approach to Object Alignment in Mixed Reality
Alejandro Martin-Gomez, Alexander Winkler, Rafael de la Tijera Obert +4
Alignment between real and virtual objects is a challenging task required for the deployment of Mixed Reality (MR) into manufacturing, medical, and construction applications. To fa…
4D-OR: Semantic Scene Graphs for OR Domain Modeling
Ege Özsoy, Evin Pınar Örnek, Ulrich Eck +3
Surgical procedures are conducted in highly complex operating rooms (OR), comprising different actors, devices, and interactions. To date, only medically trained human experts are…
Know your sensORs -- A Modality Study For Surgical Action Classification
Lennart Bastian, Tobias Czempiel, Christian Heiliger +4
The surgical operating room (OR) presents many opportunities for automation and optimization. Videos from various sources in the OR are becoming increasingly available. The medical…
Motion-Aware Robotic 3D Ultrasound
Zhongliang Jiang, Hanyu Wang, Zhenyu Li +7
Robotic three-dimensional (3D) ultrasound (US) imaging has been employed to overcome the drawbacks of traditional US examinations, such as high inter-operator variability and lack…
Multimodal Semantic Scene Graphs for Holistic Modeling of Surgical Procedures
Ege Özsoy, Evin Pınar Örnek, Ulrich Eck +2
From a computer science viewpoint, a surgical domain model needs to be a conceptual one incorporating both behavior and data. It should therefore model actors, devices, tools, thei…
Exploring Non-Reversing Magic Mirrors for Screen-Based Augmented Reality Systems
Felix Bork, Roghayeh Barmaki, Ulrich Eck +3
Screen-based Augmented Reality (AR) systems can be built as a window into the real world as often done in mobile AR applications or using the Magic Mirror metaphor, where users can…