578 citations · 2.5k across the 216 of their papers we have counts for
13 papers · 2 filters
OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretraining
Ming Hu, Kun Yuan, Yaling Shen +17
Surgical practice involves complex visual interpretation, procedural skills, and advanced medical knowledge, making surgical vision-language pretraining (VLP) particularly challeng…
MonoGSDF: Exploring Monocular Geometric Cues for Gaussian Splatting-Guided Implicit Surface Reconstruction
Kunyi Li, Michael Niemeyer, Zeyu Chen +2
Accurate meshing from monocular images remains a key challenge in 3D vision. While state-of-the-art 3D Gaussian Splatting (3DGS) methods excel at synthesizing photorealistic novel…
VISAGE: Video Synthesis using Action Graphs for Surgery
Yousef Yeganeh, Rachmadio Lazuardi, Amir Shamseddin +4
Surgical data science (SDS) is a field that analyzes patient data before, during, and after surgery to improve surgical outcomes and skills. However, surgical data is scarce, heter…
SCRREAM : SCan, Register, REnder And Map:A Framework for Annotating Accurate and Dense 3D Indoor Scenes with a Benchmark
HyunJun Jung, Weihang Li, Shun-Cheng Wu +8
Traditionally, 3d indoor datasets have generally prioritized scale over ground-truth accuracy in order to obtain improved generalization. However, using these datasets to evaluate…
Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentation
Kun Yuan, Vinkle Srivastav, Nassir Navab +1
Surgical video-language pretraining (VLP) faces unique challenges due to the knowledge domain gap and the scarcity of multi-modal data. This study aims to bridge the gap by address…
Multimodal Analysis of White Blood Cell Differentiation in Acute Myeloid Leukemia Patients using a β-Variational Autoencoder
Gizem Mert, Ario Sadafi, Raheleh Salehi +2
Biomedical imaging and RNA sequencing with single-cell resolution improves our understanding of white blood cell diseases like leukemia. By combining morphological and transcriptom…
RaNeuS: Ray-adaptive Neural Surface Reconstruction
Yida Wang, David Joseph Tan, Nassir Navab +1
Our objective is to leverage a differentiable radiance field \eg NeRF to reconstruct detailed 3D surfaces in addition to producing the standard novel view renderings. There have be…
HecVL: Hierarchical Video-Language Pretraining for Zero-shot Surgical Phase Recognition
Kun Yuan, Vinkle Srivastav, Nassir Navab +1
Natural language could play an important role in developing generalist surgical models by providing a broad source of supervision from raw texts. This flexible form of supervision…
EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusion
Guangyao Zhai, Evin Pınar Örnek, Dave Zhenyu Chen +5
We present EchoScene, an interactive and controllable generative model that generates 3D indoor scenes on scene graphs. EchoScene leverages a dual-branch diffusion model that dynam…
Neural Cellular Automata for Lightweight, Robust and Explainable Classification of White Blood Cell Images
Michael Deutges, Ario Sadafi, Nassir Navab +1
Diagnosis of hematological malignancies depends on accurate identification of white blood cells in peripheral blood smears. Deep learning techniques are emerging as a viable soluti…
FLex: Joint Pose and Dynamic Radiance Fields Optimization for Stereo Endoscopic Videos
Florian Philipp Stilz, Mert Asim Karaoglu, Felix Tristram +3
Reconstruction of endoscopic scenes is an important asset for various medical applications, from post-surgery analysis to educational training. Neural rendering has recently shown…
MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Images
Junwen Huang, Hao Yu, Kuan-Ting Yu +3
Recent learning methods for object pose estimation require resource-intensive training for each individual object instance or category, hampering their scalability in real applicat…
Physics-Encoded Graph Neural Networks for Deformation Prediction under Contact
Mahdi Saleh, Michael Sommersperger, Nassir Navab +1
In robotics, it's crucial to understand object deformation during tactile interactions. A precise understanding of deformation can elevate robotic simulations and have broad implic…