45 citations · 116 across the 92 of their papers we have counts for
54 papers · 1 filter
ProtoFlow: Interpretable and Robust Surgical Workflow Modeling with Learned Dynamic Scene Graph Prototypes
Felix Holm, Ghazal Ghazaei, Nassir Navab
Purpose: Detailed surgical recognition is critical for advancing AI-assisted surgery, yet progress is hampered by high annotation costs, data scarcity, and a lack of interpretable…
LapFM: A Laparoscopic Segmentation Foundation Model via Hierarchical Concept Evolving Pre-training
Qing Xu, Kun Yuan, Yuxiang Luo +4
Surgical segmentation is pivotal for scene understanding yet remains hindered by annotation scarcity and semantic inconsistency across diverse procedures. Existing approaches typic…
From Panel to Pixel: Zoom-In Vision-Language Pretraining from Biomedical Scientific Literature
Kun Yuan, Min Woo Sun, Zhen Chen +7
There is a growing interest in developing strong biomedical vision-language models. A popular approach to achieve robust representations is to use web-scale scientific data. Howeve…
US-X Complete: A Multi-Modal Approach to Anatomical 3D Shape Recovery
Miruna-Alexandra Gafencu, Yordanka Velikova, Nassir Navab +1
Ultrasound offers a radiation-free, cost-effective solution for real-time visualization of spinal landmarks, paraspinal soft tissues and neurovascular structures, making it valuabl…
How Far Are Surgeons from Surgical World Models? A Pilot Study on Zero-shot Surgical Video Generation with Expert Assessment
Zhen Chen, Qing Xu, Jinlin Wu +7
Foundation models in video generation are demonstrating remarkable capabilities as potential world models for simulating the physical world. However, their application in high-stak…
Towards Cellular-Scale Interpretability in Pathology Foundation Models for Biomarker Assessment
Jingsong Liu, Han Li, Zhengyang Xu +19
Molecular biomarker testing in pathology is often costly and tissue-consuming, limiting scalable clinical deployment. Artificial intelligence applied to hematoxylin and eosin (HE)-…
Current validation practice undermines surgical AI development
Annika Reinke, Ziying O. Li, Minu D. Tizabi +98
Surgical data science (SDS) is rapidly advancing, yet clinical adoption of artificial intelligence (AI) in surgery remains limited, with inadequate validation as an important contr…
Improving Robustness to Out-of-Distribution States in Imitation Learning via Deep Koopman-Boosted Diffusion Policy
Dianye Huang, Nassir Navab, Zhongliang Jiang
Integrating generative models with action chunking has shown significant promise in imitation learning for robotic manipulation. However, the existing diffusion-based paradigm ofte…
Freehand 3D Ultrasound Imaging: Sim-in-the-Loop Probe Pose Optimization via Visual Servoing
Yameng Zhang, Dianye Huang, Max Q. -H. Meng +2
Freehand 3D ultrasound (US) imaging using conventional 2D probes offers flexibility and accessibility for diverse clinical applications but faces challenges in accurate probe pose…
UltraScatter: Ray-Based Simulation of Ultrasound Scattering
Felix Duelmer, Mohammad Farid Azampour, Nassir Navab
Traditional ultrasound simulation methods solve wave equations numerically, achieving high accuracy but at substantial computational cost. Faster alternatives based on convolution…
Knowledge Graph Sparsification for GNN-based Rare Disease Diagnosis
Premt Cara, Kamilia Zaripova, David Bani-Harouni +2
Rare genetic disease diagnosis faces critical challenges: insufficient patient data, inaccessible full genome sequencing, and the immense number of possible causative genes. These…
DeepAf: One-Shot Spatiospectral Auto-Focus Model for Digital Pathology
Yousef Yeganeh, Maximilian Frantzen, Michael Lee +3
While Whole Slide Imaging (WSI) scanners remain the gold standard for digitizing pathology samples, their high cost limits accessibility in many healthcare settings. Other low-cost…
SpeechCT-CLIP: Distilling Text-Image Knowledge to Speech for Voice-Native Multimodal CT Analysis
Lukas Buess, Jan Geier, David Bani-Harouni +6
Spoken communication plays a central role in clinical workflows. In radiology, for example, most reports are created through dictation. Yet, nearly all medical AI systems rely excl…
BridgeSplat: Bidirectionally Coupled CT and Non-Rigid Gaussian Splatting for Deformable Intraoperative Surgical Navigation
Maximilian Fehrentz, Alexander Winkler, Thomas Heiliger +3
We introduce BridgeSplat, a novel approach for deformable surgical navigation that couples intraoperative 3D reconstruction with preoperative CT data to bridge the gap between surg…
A Fully Open and Generalizable Foundation Model for Ultrasound Clinical Applications
Hongyuan Zhang, Yuheng Wu, Mingyang Zhao +22
Artificial intelligence (AI) that can effectively learn ultrasound representations by integrating multi-source data holds significant promise for advancing clinical care. However,…
UltrON: Ultrasound Occupancy Networks
Magdalena Wysocki, Felix Duelmer, Ananya Bal +2
In free-hand ultrasound imaging, sonographers rely on expertise to mentally integrate partial 2D views into 3D anatomical shapes. Shape reconstruction can assist clinicians in this…
UOPSL: Unpaired OCT Predilection Sites Learning for Fundus Image Diagnosis Augmentation
Zhihao Zhao, Yinzheng Zhao, Junjie Yang +6
Significant advancements in AI-driven multimodal medical image diagnosis have led to substantial improvements in ophthalmic disease identification in recent years. However, acquiri…
CLAPS: A CLIP-Unified Auto-Prompt Segmentation for Multi-Modal Retinal Imaging
Zhihao Zhao, Yinzheng Zhao, Junjie Yang +6
Recent advancements in foundation models, such as the Segment Anything Model (SAM), have significantly impacted medical image segmentation, especially in retinal imaging, where pre…
Decoding the Surgical Scene: A Scoping Review of Scene Graphs in Surgery
Angelo Henriques, Korab Hoxha, Daniel Zapp +3
As surgical AI transitions from pixel-level detection to complex reasoning, Scene Graphs (SGs) offer the structured, relational representations necessary to decode dynamic surgical…
SurgLLM: A Versatile Large Multimodal Model with Spatial Focus and Temporal Awareness for Surgical Video Understanding
Zhen Chen, Xingjian Luo, Kun Yuan +6
Surgical video understanding is crucial for facilitating Computer-Assisted Surgery (CAS) systems. Despite significant progress in existing studies, two major limitations persist, i…
Shape Completion and Real-Time Visualization in Robotic Ultrasound Spine Acquisitions
Miruna-Alexandra Gafencu, Reem Shaban, Yordanka Velikova +2
Ultrasound (US) imaging is increasingly used in spinal procedures due to its real-time, radiation-free capabilities; however, its effectiveness is hindered by shadowing artifacts t…
Speckle2Self: Self-Supervised Ultrasound Speckle Reduction Without Clean Data
Xuesong Li, Nassir Navab, Zhongliang Jiang
Image denoising is a fundamental task in computer vision, particularly in medical ultrasound (US) imaging, where speckle noise significantly degrades image quality. Although recent…
Sonify Anything: Towards Context-Aware Sonic Interactions in AR
Laura Schütz, Sasan Matinfar, Ulrich Eck +2
In Augmented Reality (AR), virtual objects interact with real objects. However, the lack of physicality of virtual objects leads to the absence of natural sonic interactions. When…
Stress-Aware Resilient Neural Training
Ashkan Shakarami, Yousef Yeganeh, Azade Farshad +3
This paper introduces Stress-Aware Learning, a resilient neural training paradigm in which deep neural networks dynamically adjust their optimization behavior - whether under stabl…