12 papers
RoPE-Flow: Monocular Vision-based Robot Pose Estimation via 2D Graph-Conditioned 3D Flow Matching
Liangjing Shao, Wanhao Liu, Zhiwei Fang +6
Camera-to-robot pose estimation from a monocular image is significant for vision-based robot navigation and control. However, recovering 3D structural features from 2D observations…
SurgCast: Action-Conditioned Future Skeletons for Controllable Surgical World Models
Wanhao Liu, Rulin Zhou, Liangjing Shao +9
Surgical world models must turn prospective robot actions into visually faithful, structurally consistent instrument motion. We introduce SurgCast, which predicts future instrument…
Trajectory Divergence Horizon Decision for Reliable Dual-Arm Surgical Subtask Manipulation
Mingwu Su, Guankun Wang, Jinsong Lin +8
Surgical robotic systems are increasingly being adopted as clinical workload rises, motivating autonomous solutions for repetitive manipulation subtasks. Learning-based controllers…
SurgLAT: Surgical Latent Attention Tracking for Depth-Aware Robotic Laparoscope Control
Rulin Zhou, Qiujie Song, Yujie Ma +10
Autonomous laparoscopic camera control requires continuous understanding of the surgeon's operative intent in dynamic surgical scenes, where the target operative region is not a st…
Surg-UniWorld: A Unified Surgical World Model with Multimodal Control Experts
Rulin Zhou, Wanhao Liu, Guoheng Ma +8
Controllable surgical world models can provide a generative foundation for surgical artificial intelligence and simulation by synthesizing realistic instrument--tissue interactions…
CrossScope: A Role-Asymmetric World Model for Joint Dual-Scope Surgical Video Prediction
Wanhao Liu, Jinsong Lin, Rulin Zhou +11
Visual world models typically learn future dynamics from a single observation stream, limiting their ability to model cooperative systems with multiple independently moving observe…
SurgAtt-Tracker: Online Surgical Attention Tracking via Temporal Proposal Reranking and Motion-Aware Refinement
Rulin Zhou, Guankun Wang, An Wang +12
Accurate and stable field-of-view (FoV) guidance is critical for safe and efficient minimally invasive surgery, yet existing approaches often conflate visual attention estimation w…
Bridging Vision and Language for Robust Context-Aware Surgical Point Tracking: The VL-SurgPT Dataset and Benchmark
Rulin Zhou, Wenlong He, An Wang +6
Accurate point tracking in surgical environments remains challenging due to complex visual conditions, including smoke occlusion, specular reflections, and tissue deformation. Whil…
EndoControlMag: Robust Endoscopic Vascular Motion Magnification with Periodic Reference Resetting and Hierarchical Tissue-aware Dual-Mask Control
An Wang, Rulin Zhou, Mengya Xu +7
Visualizing subtle vascular motions in endoscopic surgery is crucial for surgical precision and decision-making, yet remains challenging due to the complex and dynamic nature of su…
BleedOrigin: Dynamic Bleeding Source Localization in Endoscopic Submucosal Dissection via Dual-Stage Detection and Tracking
Mengya Xu, Rulin Zhou, An Wang +4
Intraoperative bleeding during Endoscopic Submucosal Dissection (ESD) poses significant risks, demanding precise, real-time localization and continuous monitoring of the bleeding s…
Point Tracking in Surgery--The 2024 Surgical Tattoos in Infrared (STIR) Challenge
Adam Schmidt, Mert Asim Karaoglu, Soham Sinha +37
Understanding tissue motion in surgery is crucial to enable applications in downstream tasks such as segmentation, 3D reconstruction, virtual tissue landmarking, autonomous probe-b…
Endo-TTAP: Robust Endoscopic Tissue Tracking via Multi-Facet Guided Attention and Hybrid Flow-point Supervision
Rulin Zhou, Wenlong He, An Wang +4
Accurate tissue point tracking in endoscopic videos is critical for robotic-assisted surgical navigation and scene understanding, but remains challenging due to complex deformation…