3 citations · 9 across the 22 of their papers we have counts for
23 papers
Reward-Guided Semantic Evolution for Test-time Adaptive Object Detection
Lihua Zhou, Mao Ye, Xiatian Zhu +7
Open-vocabulary object detection with vision-language models (VLMs) such as Grounding DINO suffers from performance degradation under test-time distribution shifts, primarily due t…
SurgMotion: A Video-Native Foundation Model for Universal Understanding of Surgical Videos
Jinlin Wu, Felix Holm, Chuxi Chen +18
While foundation models have advanced surgical video analysis, current approaches rely predominantly on pixel-level reconstruction objectives that waste model capacity on low-level…
NeuroABench: A Multimodal Evaluation Benchmark for Neurosurgical Anatomy Identification
Ziyang Song, Zelin Zang, Xiaofan Ye +7
Multimodal Large Language Models (MLLMs) have shown significant potential in surgical video understanding. With improved zero-shot performance and more effective human-machine inte…
Bayesian Test-time Adaptation for Object Recognition and Detection with Vision-language Models
Lihua Zhou, Mao Ye, Shuaifeng Li +7
Vision-language models (VLMs) such as CLIP and Grounding DINO have achieved remarkable success in object recognition and detection. However, their performance often degrades under…
A Fully Open and Generalizable Foundation Model for Ultrasound Clinical Applications
Hongyuan Zhang, Yuheng Wu, Mingyang Zhao +22
Artificial intelligence (AI) that can effectively learn ultrasound representations by integrating multi-source data holds significant promise for advancing clinical care. However,…
SurgLLM: A Versatile Large Multimodal Model with Spatial Focus and Temporal Awareness for Surgical Video Understanding
Zhen Chen, Xingjian Luo, Kun Yuan +6
Surgical video understanding is crucial for facilitating Computer-Assisted Surgery (CAS) systems. Despite significant progress in existing studies, two major limitations persist, i…
Multimodal Causal-Driven Representation Learning for Generalizable Medical Image Segmentation
Xusheng Liang, Lihua Zhou, Nianxin Li +8
Vision-Language Models (VLMs), such as CLIP, have demonstrated remarkable zero-shot capabilities in various computer vision tasks. However, their application to medical imaging rem…
Text-Driven Causal Representation Learning for Source-Free Domain Generalization
Lihua Zhou, Mao Ye, Nianxin Li +7
Deep learning often struggles when training and test data distributions differ. Traditional domain generalization (DG) tackles this by including data from multiple source domains,…
Endo-4DGX: Robust Endoscopic Scene Reconstruction and Illumination Correction with Gaussian Splatting
Yiming Huang, Long Bai, Beilei Cui +7
Accurate reconstruction of soft tissue is crucial for advancing automation in image-guided robotic surgery. The recent 3D Gaussian Splatting (3DGS) techniques and their variants, 4…
SurgVidLM: Towards Multi-grained Surgical Video Understanding with Large Language Model
Guankun Wang, Junyi Wang, Wenjin Mo +11
Surgical scene understanding is critical for surgical training and robotic decision-making in robot-assisted surgery. Recent advances in Multimodal Large Language Models (MLLMs) ha…
Real-World Doctor Agent with Proactive Consultation through Multi-Agent Reinforcement Learning
Yichun Feng, Jiawei Wang, Lu Zhou +3
Large language models (LLMs) struggle in real-world clinical consultations. Single-turn consultation systems require patients to describe all symptoms at once, which often leads to…
Bayesian Test-Time Adaptation for Vision-Language Models
Lihua Zhou, Mao Ye, Shuaifeng Li +5
Test-time adaptation with pre-trained vision-language models, such as CLIP, aims to adapt the model to new, potentially out-of-distribution test data. Existing methods calculate th…
EndoChat: Grounded Multimodal Large Language Model for Endoscopic Surgery
Guankun Wang, Long Bai, Junyi Wang +13
Recently, Multimodal Large Language Models (MLLMs) have demonstrated their immense potential in computer-aided diagnosis and decision-making. In the context of robotic-assisted sur…
MoE-Enhanced Explainable Deep Manifold Transformation for Complex Data Embedding and Visualization
Zelin Zang, Yuhao Wang, Jinlin Wu +4
Dimensionality reduction (DR) plays a crucial role in various fields, including data engineering and visualization, by simplifying complex datasets while retaining essential inform…
SurgTrack: CAD-Free 3D Tracking of Real-world Surgical Instruments
Wenwu Guo, Jinlin Wu, Zhen Chen +4
Vision-based surgical navigation has received increasing attention due to its non-invasive, cost-effective, and flexible advantages. In particular, a critical element of the vision…
SurgPLAN++: Universal Surgical Phase Localization Network for Online and Offline Inference
Zhen Chen, Xingjian Luo, Jinlin Wu +5
Surgical phase recognition is critical for assisting surgeons in understanding surgical videos. Existing studies focused more on online surgical phase recognition, by leveraging pr…
Transforming Surgical Interventions with Embodied Intelligence for Ultrasound Robotics
Huan Xu, Jinlin Wu, Guanglin Cao +3
Ultrasonography has revolutionized non-invasive diagnostic methodologies, significantly enhancing patient outcomes across various medical domains. Despite its advancements, integra…
VS-Assistant: Versatile Surgery Assistant on the Demand of Surgeons
Zhen Chen, Xingjian Luo, Jinlin Wu +5
The surgical intervention is crucial to patient healthcare, and many studies have developed advanced algorithms to provide understanding and decision-making assistance for surgeons…
Enhancing Surgical Robots with Embodied Intelligence for Autonomous Ultrasound Scanning
Huan Xu, Jinlin Wu, Guanglin Cao +3
Ultrasound robots are increasingly used in medical diagnostics and early disease screening. However, current ultrasound robots lack the intelligence to understand human intentions…
AccidentBlip: Agent of Accident Warning based on MA-former
Yihua Shao, Yeling Xu, Xinwei Long +7
In complex transportation systems, accurately sensing the surrounding environment and predicting the risk of potential accidents is crucial. Most existing accident prediction metho…
SurgPLAN: Surgical Phase Localization Network for Phase Recognition
Xingjian Luo, You Pang, Zhen Chen +4
Surgical phase recognition is crucial to providing surgery understanding in smart operating rooms. Despite great progress in automatic surgical phase recognition, most existing met…
PWISeg: Point-based Weakly-supervised Instance Segmentation for Surgical Instruments
Zhen Sun, Huan Xu, Jinlin Wu +3
In surgical procedures, correct instrument counting is essential. Instance segmentation is a location method that locates not only an object's bounding box but also each pixel's sp…
Weakly Supervised YOLO Network for Surgical Instrument Localization in Endoscopic Videos
Rongfeng Wei, Jinlin Wu, Xuexue Bai +4
In minimally invasive surgery, surgical instrument localization is a crucial task for endoscopic videos, which enables various applications for improving surgical outcomes. However…