578 citations · 2.5k across the 216 of their papers we have counts for
45 papers · 1 filter
Deformable 3D Gaussian Splatting for Animatable Human Avatars
HyunJun Jung, Nikolas Brasch, Jifei Song +5
Recent advances in neural radiance fields enable novel view synthesis of photo-realistic images in dynamic settings, which can be applied to scenarios with human animation. Commonl…
S2P3: Self-Supervised Polarimetric Pose Prediction
Patrick Ruhkamp, Daoyi Gao, Nassir Navab +1
This paper proposes the first self-supervised 6D object pose prediction from multimodal RGB+polarimetric images. The novel training paradigm comprises 1) a physical model to extrac…
Advancing Surgical VQA with Scene Graph Knowledge
Kun Yuan, Manasi Kattel, Joel L. Lavanchy +3
Modern operating room is becoming increasingly complex, requiring innovative intra-operative support systems. While the focus of surgical data science has largely been on video ana…
Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matching
Lennart Bastian, Yizheng Xie, Nassir Navab +1
Non-isometric shape correspondence remains a fundamental challenge in computer vision. Traditional methods using Laplace-Beltrami operator (LBO) eigenmodes face limitations in char…
Re-Nerfing: Improving Novel View Synthesis through Novel View Synthesis
Felix Tristram, Stefano Gasperini, Nassir Navab +1
Recent neural rendering and reconstruction techniques, such as NeRFs or Gaussian Splatting, have shown remarkable novel view synthesis capabilities but require hundreds of images o…
DNS SLAM: Dense Neural Semantic-Informed SLAM
Kunyi Li, Michael Niemeyer, Nassir Navab +1
In recent years, coordinate-based neural implicit representations have shown promising results for the task of Simultaneous Localization and Mapping (SLAM). While achieving impress…
EyeLS: Shadow-Guided Instrument Landing System for Intraocular Target Approaching in Robotic Eye Surgery
Junjie Yang, Zhihao Zhao, Siyuan Shen +5
Robotic ophthalmic surgery is an emerging technology to facilitate high-precision interventions such as retina penetration in subretinal injection and removal of floating tissues i…
PRISM: Progressive Restoration for Scene Graph-based Image Manipulation
Pavel Jahoda, Azade Farshad, Yousef Yeganeh +2
Scene graphs have emerged as accurate descriptive priors for image generation and manipulation tasks, however, their complexity and diversity of the shapes and relations of objects…
RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistance
Chantal Pellegrini, Ege Özsoy, Benjamin Busam +2
Conversational AI tools that can generate and discuss clinically correct radiology reports for a given medical image have the potential to transform radiology. Such a human-in-the-…
Robust Tumor Segmentation with Hyperspectral Imaging and Graph Neural Networks
Mayar Lotfy Mostafa, Anna Alperovich, Tommaso Giannantonio +8
Segmenting the boundary between tumor and healthy tissue during surgical cancer resection poses a significant challenge. In recent years, Hyperspectral Imaging (HSI) combined with…
SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimation
Yamei Chen, Yan Di, Guangyao Zhai +6
Category-level object pose estimation, aiming to predict the 6D pose and 3D size of objects from known categories, typically struggles with large intra-class shape variation. Exist…
VoxNeRF: Bridging Voxel Representation and Neural Radiance Fields for Enhanced Indoor View Synthesis
Sen Wang, Qing Cheng, Stefano Gasperini +5
The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenar…
Implicit Neural Representations for Breathing-compensated Volume Reconstruction in Robotic Ultrasound
Yordanka Velikova, Mohammad Farid Azampour, Walter Simson +2
Ultrasound (US) imaging is widely used in diagnosing and staging abdominal diseases due to its lack of non-ionizing radiation and prevalent availability. However, significant inter…
RIDE: Self-Supervised Learning of Rotation-Equivariant Keypoint Detection and Invariant Description for Endoscopy
Mert Asim Karaoglu, Viktoria Markova, Nassir Navab +2
Unlike in natural images, in endoscopy there is no clear notion of an up-right camera orientation. Endoscopic videos therefore often contain large rotational motions, which require…
Dynamic Hyperbolic Attention Network for Fine Hand-object Reconstruction
Zhiying Leng, Shun-Cheng Wu, Mahdi Saleh +6
Reconstructing both objects and hands in 3D from a single RGB image is complex. Existing methods rely on manually defined hand-object constraints in Euclidean space, leading to sub…
SG-Bot: Object Rearrangement via Coarse-to-Fine Robotic Imagination on Scene Graphs
Guangyao Zhai, Xiaoni Cai, Dianye Huang +5
Object rearrangement is pivotal in robotic-environment interactions, representing a significant capability in embodied AI. In this paper, we present SG-Bot, a novel rearrangement f…
DynaMoN: Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fields
Nicolas Schischka, Hannah Schieber, Mert Asim Karaoglu +6
The accurate reconstruction of dynamic scenes with neural radiance fields is significantly dependent on the estimation of camera poses. Widely used structure-from-motion pipelines…
BigFUSE: Global Context-Aware Image Fusion in Dual-View Light-Sheet Fluorescence Microscopy with Image Formation Prior
Yu Liu, Gesine Muller, Nassir Navab +3
Light-sheet fluorescence microscopy (LSFM), a planar illumination technique that enables high-resolution imaging of samples, experiences defocused image quality caused by light sca…
On the Localization of Ultrasound Image Slices within Point Distribution Models
Lennart Bastian, Vincent Bürgin, Ha Young Kim +4
Thyroid disorders are most commonly diagnosed using high-resolution Ultrasound (US). Longitudinal nodule tracking is a pivotal diagnostic protocol for monitoring changes in patholo…
3D Adversarial Augmentations for Robust Out-of-Domain Predictions
Alexander Lehner, Stefano Gasperini, Alvaro Marcos-Ramiro +4
Since real-world training datasets cannot properly sample the long tail of the underlying data distribution, corner cases and rare out-of-domain samples can severely hinder the per…
Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Data
Patrick Ruhkamp, Daoyi Gao, HyunJun Jung +2
6D pose estimation pipelines that rely on RGB-only or RGB-D data show limitations for photometrically challenging objects with e.g. textureless surfaces, reflections or transparenc…
Robust Monocular Depth Estimation under Challenging Conditions
Stefano Gasperini, Nils Morbitzer, HyunJun Jung +2
While state-of-the-art monocular depth estimation approaches achieve impressive results in ideal settings, they are highly unreliable under challenging illumination and weather con…
DISBELIEVE: Distance Between Client Models is Very Essential for Effective Local Model Poisoning Attacks
Indu Joshi, Priyank Upadhya, Gaurav Kumar Nayak +2
Federated learning is a promising direction to tackle the privacy issues related to sharing patients' sensitive data. Often, federated systems in the medical image analysis domain…
DisguisOR: Holistic Face Anonymization for the Operating Room
Lennart Bastian, Tony Danjun Wang, Tobias Czempiel +2
Purpose: Recent advances in Surgical Data Science (SDS) have contributed to an increase in video recordings from hospital environments. While methods such as surgical workflow reco…