activity
20222026
most citedTowards Robust Surgical Automation via Digital Twin Representations from Foundation Models

2 citations · 4 across the 12 of their papers we have counts for

collaborators

13 papers

cs.GR2026

The Role of Mixed and Augmented Reality in Medical Visualization: Literature Review and A Context-Aware Taxonomy

Xinrui Zou, Mingxu Liu, Hongchao Shu +3

The discovery and evolution of medical imaging technologies have enabled non-invasive visualization of internal anatomy that has be- come essential for supporting diagnosis, monito…

cs.CV2026

Geometry-Consistent Endoscopic Representations for Image-Guided Navigation via Structured Foundation Model Adaptation

Hongchao Shu, Roger D. Soberanis-Mukul, Hao Ding +5

Accurate vision-based navigation in monocular endoscopy is difficult due to limited depth cues, weak tissue texture, non-rigid deformation, and substantial appearance variation acr…

cs.HC2026

Extend Your Horizon: A Device-Agnostic Surgical Tool Tracking Framework with Multi-View Optimization for Augmented Reality

Jiaming Zhang, Mingxu Liu, Hongchao Shu +6

Surgical navigation provides real-time guidance by estimating the pose of patient anatomy and surgical instruments to visualize relevant intraoperative information. In conventional…

eess.IV2025

DualVision ArthroNav: Investigating Opportunities to Enhance Localization and Reconstruction in Image-based Arthroscopy Navigation via External Cameras

Hongchao Shu, Lalithkumar Seenivasan, Mingxu Liu +6

Arthroscopic procedures can greatly benefit from navigation systems that enhance spatial awareness, depth perception, and field of view. However, existing optical tracking solution…

cs.CV2025

BronchOpt : Vision-Based Pose Optimization with Fine-Tuned Foundation Models for Accurate Bronchoscopy Navigation

Hongchao Shu, Roger D. Soberanis-Mukul, Jiru Xu +6

Accurate intra-operative localization of the bronchoscope tip relative to patient anatomy remains challenging due to respiratory motion, anatomical variability, and CT-to-body dive…

cs.CV2025

Egosurg: Arbitrary view synthesis for egocentric replay of operating room workflows from ambient cameras

Han Zhang, Lalithkumar Seenivasan, Jose L. Porras +10

Observing surgical practice has historically relied on fixed vantage points or recollections, leaving the egocentric perspectives that shape clinical decisions undocumented. Ambien…

cs.CV2024

Towards Robust Algorithms for Surgical Phase Recognition via Digital Twin Representation

Hao Ding, Yuqian Zhang, Wenzheng Cheng +7

Surgical phase recognition (SPR) is an integral component of surgical data science, enabling high-level surgical analysis. End-to-end trained neural networks that predict surgical…

cs.CV2024

Seamless Augmented Reality Integration in Arthroscopy: A Pipeline for Articular Reconstruction and Guidance

Hongchao Shu, Mingxu Liu, Lalithkumar Seenivasan +5

Arthroscopy is a minimally invasive surgical procedure used to diagnose and treat joint problems. The clinical workflow of arthroscopy typically involves inserting an arthroscope i…

cs.RO2024★ 2 cited

Towards Robust Surgical Automation via Digital Twin Representations from Foundation Models

Hao Ding, Lalithkumar Seenivasan, Hongchao Shu +7

Large language model-based (LLM) agents are emerging as a powerful enabler of robust embodied intelligence due to their capability of planning complex action sequences. Sound plann…

cs.CV2024★ 1 cited

SegSTRONG-C: Segmenting Surgical Tools Robustly On Non-adversarial Generated Corruptions -- An EndoVis'24 Challenge

Hao Ding, Yuqian Zhang, Tuxun Lu +39

Surgical data science has seen rapid advancement with the excellent performance of end-to-end deep neural networks (DNNs). Despite their successes, DNNs have been proven susceptibl…

cs.CV2022★ 1 cited

TAToo: Vision-based Joint Tracking of Anatomy and Tool for Skull-base Surgery

Zhaoshuo Li, Hongchao Shu, Ruixing Liang +5

Purpose: Tracking the 3D motion of the surgical tool and the patient anatomy is a fundamental requirement for computer-assisted skull-base surgery. The estimated motion can be used…

cs.HC2022

Twin-S: A Digital Twin for Skull-base Surgery

Hongchao Shu, Ruixing Liang, Zhaoshuo Li +9

Purpose: Digital twins are virtual interactive models of the real world, exhibiting identical behavior and properties. In surgical applications, computational analysis from digital…

cs.LG2022

PQLM -- Multilingual Decentralized Portable Quantum Language Model for Privacy Protection

Shuyue Stella Li, Xiangyu Zhang, Shu Zhou +4

With careful manipulation, malicious agents can reverse engineer private information encoded in pre-trained language models. Security concerns motivate the development of quantum p…