Surgical Instruction Generation with Transformers

Jinglu Zhang, Yinyu Nie, Jian Chang +1

Automatic surgical instruction generation is a prerequisite towards intra-operative context-aware surgical assistance. However, generating instructions from surgical scenes is chal…