6 papers
RoPE-Flow: Monocular Vision-based Robot Pose Estimation via 2D Graph-Conditioned 3D Flow Matching
Liangjing Shao, Wanhao Liu, Zhiwei Fang +6
Camera-to-robot pose estimation from a monocular image is significant for vision-based robot navigation and control. However, recovering 3D structural features from 2D observations…
SurgCast: Action-Conditioned Future Skeletons for Controllable Surgical World Models
Wanhao Liu, Rulin Zhou, Liangjing Shao +9
Surgical world models must turn prospective robot actions into visually faithful, structurally consistent instrument motion. We introduce SurgCast, which predicts future instrument…
SurgLAT: Surgical Latent Attention Tracking for Depth-Aware Robotic Laparoscope Control
Rulin Zhou, Qiujie Song, Yujie Ma +10
Autonomous laparoscopic camera control requires continuous understanding of the surgeon's operative intent in dynamic surgical scenes, where the target operative region is not a st…
Surg-UniWorld: A Unified Surgical World Model with Multimodal Control Experts
Rulin Zhou, Wanhao Liu, Guoheng Ma +8
Controllable surgical world models can provide a generative foundation for surgical artificial intelligence and simulation by synthesizing realistic instrument--tissue interactions…
CrossScope: A Role-Asymmetric World Model for Joint Dual-Scope Surgical Video Prediction
Wanhao Liu, Jinsong Lin, Rulin Zhou +11
Visual world models typically learn future dynamics from a single observation stream, limiting their ability to model cooperative systems with multiple independently moving observe…
EndoWAM: A Grounded World-Action Model for Generalizable Endoscopic Navigation
Jinsong Lin, Zikang Pan, Wanhao Liu +10
Autonomous endoscopic navigation can reduce clinicians' operational burden, yet robust control remains challenging due to tissue deformation, transient occlusions, and rapidly chan…