Surgical Action Planning with Large Language Models

Mengya Xu, Zhongzhen Huang, Jie Zhang +2

In robot-assisted minimally invasive surgery, we introduce the Surgical Action Planning (SAP) task, which generates future action plans from visual inputs to address the absence of…