218 citations · 264 across the 23 of their papers we have counts for
25 papers
MEMO: Multimodal Evidence Memory Organization for Long-Horizon LLM Agents
Xian Gao, Jinpeng Wang, Jiacheng Ruan +3
Long-running LLM agents rely on external memory to store and reuse information beyond a single context window, yet there is a fundamental tension between the continuous accumulatio…
Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZ
Zongyun Zhang, Jiacheng Ruan, Xian Gao +5
Although multimodal large language models (MLLMs) have shown substantial potential in visual understanding and graphic code generation, editing scientific figures through code pres…
BasketHAR: A Multimodal Dataset for Human Activity Recognition and Sport Analysis in Basketball Training Scenarios
Xian Gao, Haoyue Zhang, Zongyun Zhang +3
Human Activity Recognition (HAR) involves the automatic identification of user activities and has gained significant research interest due to its broad applicability. Most HAR syst…
BALR-SAM: Boundary-Aware Low-Rank Adaptation of SAM for Resource-Efficient Medical Image Segmentation
Zelin Liu, Sicheng Dong, Bocheng Li +4
Vision foundation models like the Segment Anything Model (SAM), pretrained on large-scale natural image datasets, often struggle in medical image segmentation due to a lack of doma…
MME-SCI: A Comprehensive and Challenging Science Benchmark for Multimodal Large Language Models
Jiacheng Ruan, Dan Jiang, Xian Gao +3
Recently, multimodal large language models (MLLMs) have achieved significant advancements across various domains, and corresponding evaluation benchmarks have been continuously ref…
Wisdom of the Crowd: Reinforcement Learning from Coevolutionary Collective Feedback
Wenzhen Yuan, Shengji Tang, Weihao Lin +8
Reinforcement learning (RL) has significantly enhanced the reasoning capabilities of large language models (LLMs), but its reliance on expensive human-labeled data or complex rewar…
MMReview: A Multidisciplinary and Multimodal Benchmark for LLM-Based Peer Review Automation
Xian Gao, Jiacheng Ruan, Zongyun Zhang +3
With the rapid growth of academic publications, peer review has become an essential yet time-consuming responsibility within the research community. Large Language Models (LLMs) ha…
VLRMBench: A Comprehensive and Challenging Benchmark for Vision-Language Reward Models
Jiacheng Ruan, Wenzhen Yuan, Xian Gao +6
Although large visual-language models (LVLMs) have demonstrated strong performance in multimodal tasks, errors may occasionally arise due to biases during the reasoning process. Re…
EIAD: Explainable Industrial Anomaly Detection Via Multi-Modal Large Language Models
Zongyun Zhang, Jiacheng Ruan, Xian Gao +2
Industrial Anomaly Detection (IAD) is critical to ensure product quality during manufacturing. Although existing zero-shot defect segmentation and detection methods have shown effe…
ReviewAgents: Bridging the Gap Between Human and AI-Generated Paper Reviews
Xian Gao, Jiacheng Ruan, Zongyun Zhang +3
Academic paper review is a critical yet time-consuming task within the research community. With the increasing volume of academic publications, automating the review process has be…
From Motion Signals to Insights: A Unified Framework for Student Behavior Analysis and Feedback in Physical Education Classes
Xian Gao, Jiacheng Ruan, Jingsheng Gao +4
Analyzing student behavior in educational scenarios is crucial for enhancing teaching quality and student engagement. Existing AI-based models often rely on classroom video footage…
Understanding Robustness of Parameter-Efficient Tuning for Image Classification
Jiacheng Ruan, Xian Gao, Suncheng Xiang +3
Parameter-efficient tuning (PET) techniques calibrate the model's predictions on downstream tasks by freezing the pre-trained models and introducing a small number of learnable par…
MM-CamObj: A Comprehensive Multimodal Dataset for Camouflaged Object Scenarios
Jiacheng Ruan, Wenzhen Yuan, Zehao Lin +5
Large visual-language models (LVLMs) have achieved great success in multiple applications. However, they still encounter challenges in complex scenes, especially those involving ca…
Learning Collaborative Knowledge with Multimodal Representation for Polyp Re-Identification
Suncheng Xiang, Jiale Guan, Shilun Cai +2
Colonoscopic Polyp Re-Identification aims to match the same polyp from a large gallery with images from different views taken using different cameras, which plays an important role…
iDAT: inverse Distillation Adapter-Tuning
Jiacheng Ruan, Jingsheng Gao, Mingye Xie +4
Adapter-Tuning (AT) method involves freezing a pre-trained model and introducing trainable adapter modules to acquire downstream knowledge, thereby calibrating the model for better…
VM-UNet: Vision Mamba UNet for Medical Image Segmentation
Jiacheng Ruan, Jincheng Li, Suncheng Xiang
In the realm of medical image segmentation, both CNN-based and Transformer-based models have been extensively explored. However, CNNs exhibit limitations in long-range modeling cap…
Oceanship: A Large-Scale Dataset for Underwater Audio Target Recognition
Zeyu Li, Suncheng Xiang, Tong Yu +5
The recognition of underwater audio plays a significant role in identifying a vessel while it is in motion. Underwater target recognition tasks have a wide range of applications in…
LAMM: Label Alignment for Multi-Modal Prompt Learning
Jingsheng Gao, Jiacheng Ruan, Suncheng Xiang +5
With the success of pre-trained visual-language (VL) models such as CLIP in visual representation tasks, transferring pre-trained models to downstream tasks has become a crucial pa…
GIST: Improving Parameter Efficient Fine Tuning via Knowledge Interaction
Jiacheng Ruan, Jingsheng Gao, Mingye Xie +4
The Parameter-Efficient Fine-Tuning (PEFT) method, which adjusts or introduces fewer trainable parameters to calibrate pre-trained models on downstream tasks, has become a recent r…
Learning Multi-axis Representation in Frequency Domain for Medical Image Segmentation
Jiacheng Ruan, Jingsheng Gao, Mingye Xie +1
Recently, Visual Transformer (ViT) has been extensively used in medical image segmentation (MIS) due to applying self-attention mechanism in the spatial domain to modeling global k…
EGE-UNet: an Efficient Group Enhanced UNet for skin lesion segmentation
Jiacheng Ruan, Mingye Xie, Jingsheng Gao +2
Transformer and its variants have been widely used for medical image segmentation. However, the large number of parameter and computational load of these models make them unsuitabl…
Learning Robust Visual-Semantic Embedding for Generalizable Person Re-identification
Suncheng Xiang, Jingsheng Gao, Mengyuan Guan +5
Generalizable person re-identification (Re-ID) is a very hot research topic in machine learning and computer vision, which plays a significant role in realistic scenarios due to it…
MALUNet: A Multi-Attention and Light-weight UNet for Skin Lesion Segmentation
Jiacheng Ruan, Suncheng Xiang, Mingye Xie +2
Recently, some pioneering works have preferred applying more complex modules to improve segmentation performances. However, it is not friendly for actual clinical environments due…
MEW-UNet: Multi-axis representation learning in frequency domain for medical image segmentation
Jiacheng Ruan, Mingye Xie, Suncheng Xiang +2
Recently, Visual Transformer (ViT) has been widely used in various fields of computer vision due to applying self-attention mechanism in the spatial domain to modeling global knowl…