10 papers
RefineRank: Joint Box Refinement and Ranking for Surgical Spatio-Temporal Grounding
Linzhe Jiang, Jiayuan Huang, Changhao Zhang +3
Surgical spatio-temporal grounding (STG) requires locating, at each video time specified by a procedural question, the object that the question asks about. Existing approaches face…
TemporalDoRA: Temporal PEFT for Robust Surgical Video Question Answering
Luca Carlini, Chiara Lena, Cesare Hassan +4
Surgical Video Question Answering (VideoQA) requires accurate temporal grounding while remaining robust to natural variation in how clinicians phrase questions, where linguistic bi…
SurgFusion-Net: Diversified Adaptive Multimodal Fusion Network for Surgical Skill Assessment
Runlong He, Freweini M. Tesfai, Matthew W. E. Boal +13
Robotic-assisted surgery (RAS) is established in clinical practice, and automated surgical skill assessment utilizing multimodal data offers transformative potential for surgical a…
SurgAnt-ViVQA: Learning to Anticipate Surgical Events through GRU-Driven Temporal Cross-Attention
Shreyas C. Dhake, Jiayuan Huang, Runlong He +7
Anticipating forthcoming surgical events is vital for real-time assistance in endonasal transsphenoidal pituitary surgery, where visibility is limited and workflow changes rapidly.…
Subsampled Randomized Fourier GaLore for Adapting Foundation Models in Depth-Driven Liver Landmark Segmentation
Yun-Chen Lin, Jiayuan Huang, Hanyuan Zhang +3
Accurate detection and delineation of anatomical structures in medical imaging are critical for computer-assisted interventions, particularly in laparoscopic liver surgery where 2D…
SurgViVQA: Temporally-Grounded Video Question Answering for Surgical Scene Understanding
Mauro Orazio Drago, Luca Carlini, Pelinsu Celebi Balyemez +7
Video Question Answering (VideoQA) in the surgical domain aims to enhance intraoperative understanding by enabling AI models to reason over temporally coherent events rather than i…
When to Trust the Answer: Question-Aligned Semantic Nearest Neighbor Entropy for Safer Surgical VQA
Luca Carlini, Dennis Pierantozzi, Mauro Orazio Drago +6
Safety and reliability are critical for deploying visual question answering (VQA) systems in surgery, where incorrect or ambiguous responses can cause patient harm. A key limitatio…
C3VDReg: A Benchmark for Local-to-Local Colonoscopic Registration toward Anatomical Localization
Linzhe Jiang, Jiayuan Huang, Sophia Bano +3
Anatomy-aware colonoscopic navigation requires localizing partial endoscopic observations on a stable 3D reference to support coverage assessment, revisited-region awareness, and C…
EndoSfM3D: Learning to 3D Reconstruct Any Endoscopic Surgery Scene using Self-supervised Foundation Model
Changhao Zhang, Matthew J. Clarkson, Mobarak I. Hoque
3D reconstruction of endoscopic surgery scenes plays a vital role in enhancing scene perception, enabling AR visualization, and supporting context-aware decision-making in image-gu…
SurgTPGS: Semantic 3D Surgical Scene Understanding with Text Promptable Gaussian Splatting
Yiming Huang, Long Bai, Beilei Cui +6
In contemporary surgical research and practice, accurately comprehending 3D surgical scenes with text-promptable capabilities is particularly crucial for surgical planning and real…