126 citations · 734 across the 65 of their papers we have counts for
16 papers · 1 filter
Pose-dependent weights and Domain Randomization for fully automatic X-ray to CT Registration
Matthias Grimm, Javier Esteban, Mathias Unberath +1
Fully automatic X-ray to CT registration requires a solid initialization to provide an initial alignment within the capture range of existing intensity-based registrations. This wo…
Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformers
Zhaoshuo Li, Xingtong Liu, Nathan Drenkow +4
Stereo depth estimation relies on optimal correspondence matching between pixels on epipolar lines in the left and right images to infer depth. In this work, we revisit the problem…
Relational Graph Learning on Visual and Kinematics Embeddings for Accurate Gesture Recognition in Robotic Surgery
Yonghao Long, Jie Ying Wu, Bo Lu +5
Automatic surgical gesture recognition is fundamentally important to enable intelligent cognitive assistance in robotic surgery. With recent advancement in robot-assisted minimally…
Multimodal and self-supervised representation learning for automatic gesture recognition in surgical robotics
Aniruddha Tamhane, Jie Ying Wu, Mathias Unberath
Self-supervised, multi-modal learning has been successful in holistic representation of complex scenarios. This can be useful to consolidate information from multiple modalities wh…
A Learning-based Method for Online Adjustment of C-arm Cone-Beam CT Source Trajectories for Artifact Avoidance
Mareike Thies, Jan-Nico Zäch, Cong Gao +4
During spinal fusion surgery, screws are placed close to critical nerves suggesting the need for highly accurate screw placement. Verifying screw placement on high-quality tomograp…
Augment Yourself: Mixed Reality Self-Augmentation Using Optical See-through Head-mounted Displays and Physical Mirrors
Mathias Unberath, Kevin Yu, Roghayeh Barmaki +2
Optical see-though head-mounted displays (OST HMDs) are one of the key technologies for merging virtual objects and physical scenes to provide an immersive mixed reality (MR) envir…
Artificial Intelligence-based Clinical Decision Support for COVID-19 -- Where Art Thou?
Mathias Unberath, Kimia Ghobadi, Scott Levin +2
The COVID-19 crisis has brought about new clinical questions, new workflows, and accelerated distributed healthcare needs. While artificial intelligence (AI)-based clinical decisio…
A County-level Dataset for Informing the United States' Response to COVID-19
Benjamin D. Killeen, Jie Ying Wu, Kinjal Shah +8
As the coronavirus disease 2019 (COVID-19) continues to be a global pandemic, policy makers have enacted and reversed non-pharmaceutical interventions with various levels of restri…
Extremely Dense Point Correspondences using a Learned Feature Descriptor
Xingtong Liu, Yiping Zheng, Benjamin Killeen +4
High-quality 3D reconstructions from endoscopy video play an important role in many clinical applications, including surgical navigation where they enable direct video-CT registrat…
Generalizing Spatial Transformers to Projective Geometry with Applications to 2D/3D Registration
Cong Gao, Xingtong Liu, Wenhao Gu +4
Differentiable rendering is a technique to connect 3D scenes with corresponding 2D images. Since it is differentiable, processes during image formation can be learned. Previous app…
Leveraging Vision and Kinematics Data to Improve Realism of Biomechanic Soft-tissue Simulation for Robotic Surgery
Jie Ying Wu, Peter Kazanzides, Mathias Unberath
Purpose Surgical simulations play an increasingly important role in surgeon education and developing algorithms that enable robots to perform surgical subtasks. To model anatomy, F…
From Perspective X-ray Imaging to Parallax-Robust Orthographic Stitching
Javad Fotouhi, Xingtong Liu, Mehran Armand +2
Stitching images acquired under perspective projective geometry is a relevant topic in computer vision with multiple applications ranging from smartphone panoramas to the construct…
Spatiotemporal-Aware Augmented Reality: Redefining HCI in Image-Guided Therapy
Javad Fotouhi, Arian Mehrfard, Tianyu Song +5
Suboptimal interaction with patient data and challenges in mastering 3D anatomy based on ill-posed 2D interventional images are essential concerns in image-guided therapies. Augmen…
Reconstructing Sinus Anatomy from Endoscopic Video -- Towards a Radiation-free Approach for Quantitative Longitudinal Assessment
Xingtong Liu, Maia Stiber, Jindan Huang +4
Reconstructing accurate 3D surface models of sinus anatomy directly from an endoscopic video is a promising avenue for cross-sectional and longitudinal analysis to better understan…
Exploring Partial Intrinsic and Extrinsic Symmetry in 3D Medical Imaging
Javad Fotouhi, Giacomo Taylor, Mathias Unberath +5
We present a novel methodology to detect imperfect bilateral symmetry in CT of human anatomy. In this paper, the structurally symmetric nature of the pelvic bone is explored and is…
2018 Robotic Scene Segmentation Challenge
Max Allan, Satoshi Kondo, Sebastian Bodenstedt +38
In 2015 we began a sub-challenge at the EndoVis workshop at MICCAI in Munich using endoscope images of ex-vivo tissue with automatically generated annotations from robot forward ki…