578 citations · 2.5k across the 216 of their papers we have counts for
35 papers · 2 filters
Deformable 3D Gaussian Splatting for Animatable Human Avatars
HyunJun Jung, Nikolas Brasch, Jifei Song +5
Recent advances in neural radiance fields enable novel view synthesis of photo-realistic images in dynamic settings, which can be applied to scenarios with human animation. Commonl…
S2P3: Self-Supervised Polarimetric Pose Prediction
Patrick Ruhkamp, Daoyi Gao, Nassir Navab +1
This paper proposes the first self-supervised 6D object pose prediction from multimodal RGB+polarimetric images. The novel training paradigm comprises 1) a physical model to extrac…
Advancing Surgical VQA with Scene Graph Knowledge
Kun Yuan, Manasi Kattel, Joel L. Lavanchy +3
Modern operating room is becoming increasingly complex, requiring innovative intra-operative support systems. While the focus of surgical data science has largely been on video ana…
Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matching
Lennart Bastian, Yizheng Xie, Nassir Navab +1
Non-isometric shape correspondence remains a fundamental challenge in computer vision. Traditional methods using Laplace-Beltrami operator (LBO) eigenmodes face limitations in char…
Re-Nerfing: Improving Novel View Synthesis through Novel View Synthesis
Felix Tristram, Stefano Gasperini, Nassir Navab +1
Recent neural rendering and reconstruction techniques, such as NeRFs or Gaussian Splatting, have shown remarkable novel view synthesis capabilities but require hundreds of images o…
DNS SLAM: Dense Neural Semantic-Informed SLAM
Kunyi Li, Michael Niemeyer, Nassir Navab +1
In recent years, coordinate-based neural implicit representations have shown promising results for the task of Simultaneous Localization and Mapping (SLAM). While achieving impress…
RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistance
Chantal Pellegrini, Ege Özsoy, Benjamin Busam +2
Conversational AI tools that can generate and discuss clinically correct radiology reports for a given medical image have the potential to transform radiology. Such a human-in-the-…
SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimation
Yamei Chen, Yan Di, Guangyao Zhai +6
Category-level object pose estimation, aiming to predict the 6D pose and 3D size of objects from known categories, typically struggles with large intra-class shape variation. Exist…
VoxNeRF: Bridging Voxel Representation and Neural Radiance Fields for Enhanced Indoor View Synthesis
Sen Wang, Qing Cheng, Stefano Gasperini +5
The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenar…
RIDE: Self-Supervised Learning of Rotation-Equivariant Keypoint Detection and Invariant Description for Endoscopy
Mert Asim Karaoglu, Viktoria Markova, Nassir Navab +2
Unlike in natural images, in endoscopy there is no clear notion of an up-right camera orientation. Endoscopic videos therefore often contain large rotational motions, which require…
Dynamic Hyperbolic Attention Network for Fine Hand-object Reconstruction
Zhiying Leng, Shun-Cheng Wu, Mahdi Saleh +6
Reconstructing both objects and hands in 3D from a single RGB image is complex. Existing methods rely on manually defined hand-object constraints in Euclidean space, leading to sub…
DynaMoN: Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fields
Nicolas Schischka, Hannah Schieber, Mert Asim Karaoglu +6
The accurate reconstruction of dynamic scenes with neural radiance fields is significantly dependent on the estimation of camera poses. Widely used structure-from-motion pipelines…
3D Adversarial Augmentations for Robust Out-of-Domain Predictions
Alexander Lehner, Stefano Gasperini, Alvaro Marcos-Ramiro +4
Since real-world training datasets cannot properly sample the long tail of the underlying data distribution, corner cases and rare out-of-domain samples can severely hinder the per…
Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Data
Patrick Ruhkamp, Daoyi Gao, HyunJun Jung +2
6D pose estimation pipelines that rely on RGB-only or RGB-D data show limitations for photometrically challenging objects with e.g. textureless surfaces, reflections or transparenc…
Robust Monocular Depth Estimation under Challenging Conditions
Stefano Gasperini, Nils Morbitzer, HyunJun Jung +2
While state-of-the-art monocular depth estimation approaches achieve impressive results in ideal settings, they are highly unreliable under challenging illumination and weather con…
DisguisOR: Holistic Face Anonymization for the Operating Room
Lennart Bastian, Tony Danjun Wang, Tobias Czempiel +2
Purpose: Recent advances in Surgical Data Science (SDS) have contributed to an increase in video recordings from hospital environments. While methods such as surgical workflow reco…
DISA: DIfferentiable Similarity Approximation for Universal Multimodal Registration
Matteo Ronchetti, Wolfgang Wein, Nassir Navab +2
Multimodal image registration is a challenging but essential step for numerous image-guided procedures. Most registration algorithms rely on the computation of complex, frequently…
Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures
Kun Yuan, Vinkle Srivastav, Tong Yu +5
Recent advancements in surgical computer vision applications have been driven by vision-only models, which do not explicitly integrate the rich semantics of language into their des…
Incremental 3D Semantic Scene Graph Prediction from RGB Sequences
Shun-Cheng Wu, Keisuke Tateno, Nassir Navab +1
3D semantic scene graphs are a powerful holistic representation as they describe the individual objects and depict the relation between them. They are compact high-level graphs tha…
CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusion
Guangyao Zhai, Evin Pınar Örnek, Shun-Cheng Wu +4
Controllable scene synthesis aims to create interactive environments for various industrial use cases. Scene graphs provide a highly suitable interface to facilitate these applicat…
Next-generation Surgical Navigation: Marker-less Multi-view 6DoF Pose Estimation of Surgical Instruments
Jonas Hein, Nicola Cavalcanti, Daniel Suter +7
State-of-the-art research of traditional computer vision is increasingly leveraged in the surgical domain. A particular focus in computer-assisted surgery is to replace marker-base…
IPCC-TP: Utilizing Incremental Pearson Correlation Coefficient for Joint Multi-Agent Trajectory Prediction
Dekai Zhu, Guangyao Zhai, Yan Di +6
Reliable multi-agent trajectory prediction is crucial for the safe planning and control of autonomous systems. Compared with single-agent cases, the major challenge in simultaneous…
SceneGenie: Scene Graph Guided Diffusion Models for Image Synthesis
Azade Farshad, Yousef Yeganeh, Yu Chi +3
Text-conditioned image generation has made significant progress in recent years with generative adversarial networks and more recently, diffusion models. While diffusion models con…
DIAMANT: Dual Image-Attention Map Encoders For Medical Image Segmentation
Yousef Yeganeh, Azade Farshad, Peter Weinberger +3
Although purely transformer-based architectures showed promising performance in many computer vision tasks, many hybrid models consisting of CNN and transformer blocks are introduc…