458 citations · 922 across the 17 of their papers we have counts for
17 papers
Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures
Kun Yuan, Vinkle Srivastav, Tong Yu +5
Recent advancements in surgical computer vision applications have been driven by vision-only models, which do not explicitly integrate the rich semantics of language into their des…
Weakly Supervised Temporal Convolutional Networks for Fine-grained Surgical Activity Recognition
Sanat Ramesh, Diego Dall'Alba, Cristians Gonzalez +6
Automatic recognition of fine-grained surgical activities, called steps, is a challenging but crucial task for intelligent intra-operative computer assistance. The development of c…
CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detection
Chinedu Innocent Nwoye, Tong Yu, Saurav Sharma +46
Formalizing surgical activities as triplets of the used instruments, actions performed, and target anatomies is becoming a gold standard approach for surgical activity modeling. Th…
Dissecting Self-Supervised Learning Methods for Surgical Computer Vision
Sanat Ramesh, Vinkle Srivastav, Deepak Alapatt +10
The field of surgical computer vision has undergone considerable breakthroughs in recent years with the rising popularity of deep neural network-based methods. However, standard fu…
ChordMixer: A Scalable Neural Attention Model for Sequences with Different Lengths
Ruslan Khalitov, Tong Yu, Lei Cheng +1
Sequential data naturally have different lengths in many domains, with some very long sequences. As an important modeling tool, neural attention should capture long-range interacti…
CholecTriplet2021: A benchmark challenge for surgical action triplet recognition
Chinedu Innocent Nwoye, Deepak Alapatt, Tong Yu +59
Context-aware decision support in the operating room can foster surgical safety and efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing works…
Live Laparoscopic Video Retrieval with Compressed Uncertainty
Tong Yu, Pietro Mascagni, Juan Verde +3
Searching through large volumes of medical data to retrieve relevant information is a challenging yet crucial task for clinical care. However the primitive and most common approach…
Classification of Long Sequential Data using Circular Dilated Convolutional Neural Networks
Lei Cheng, Ruslan Khalitov, Tong Yu +1
Classification of long sequential data is an important Machine Learning task and appears in many application scenarios. Recurrent Neural Networks, Transformers, and Convolutional N…
Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learning
Shaohua Wu, Xudong Zhao, Tong Yu +8
Recent work like GPT-3 has demonstrated excellent performance of Zero-Shot and Few-Shot learning on many natural language processing (NLP) tasks by scaling up model size, dataset s…
Comparative Validation of Machine Learning Algorithms for Surgical Workflow and Skill Analysis with the HeiChole Benchmark
Martin Wagner, Beat-Peter Müller-Stich, Anna Kisilenko +38
PURPOSE: Surgical workflow and skill analysis are key technologies for the next generation of cognitive surgical assistance systems. These systems could increase the safety of the…
Sparse Factorization of Large Square Matrices
Ruslan Khalitov, Tong Yu, Lei Cheng +1
Square matrices appear in many machine learning problems and models. Optimization over a large square matrix is expensive in memory and in time. Therefore an economic approximation…
Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videos
Chinedu Innocent Nwoye, Tong Yu, Cristians Gonzalez +5
Out of all existing frameworks for surgical workflow analysis in endoscopic videos, action triplet recognition stands out as the only one aiming to provide truly fine-grained and c…
Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedures
Sanat Ramesh, Diego Dall'Alba, Cristians Gonzalez +6
Purpose: Automatic segmentation and classification of surgical activity is crucial for providing advanced support in computer-assisted interventions and autonomous functionalities…
Encode the Unseen: Predictive Video Hashing for Scalable Mid-Stream Retrieval
Tong Yu, Nicolas Padoy
This paper tackles a new problem in computer vision: mid-stream video-to-video retrieval. This task, which consists in searching a database for content similar to a video right as…
Recognition of Instrument-Tissue Interactions in Endoscopic Videos via Action Triplets
Chinedu Innocent Nwoye, Cristians Gonzalez, Tong Yu +4
Recognition of surgical activity is an essential component to develop context-aware decision support for the operating room. In this work, we tackle the recognition of fine-grained…
Hyper-Parameter Optimization: A Review of Algorithms and Applications
Tong Yu, Hong Zhu
Since deep neural networks were developed, they have made huge contributions to everyday lives. Machine learning provides more rational advice than humans are capable of in almost…
Learning from a tiny dataset of manual annotations: a teacher/student approach for surgical phase recognition
Tong Yu, Didier Mutter, Jacques Marescaux +1
Vision algorithms capable of interpreting scenes from a real-time video stream are necessary for computer-assisted surgery systems to achieve context-aware behavior. In laparoscopi…