29 citations · 82 across the 29 of their papers we have counts for
23 papers · 1 filter
Adapting Vision Foundation Models with Cascaded Semantics
Xi Xiao, Xingjian Li, Cheng Han +8
Prompt tuning, a leading parameter-efficient adaptation paradigm in NLP, has recently been extended to computer vision. Visual prompt tuning (VPT) adapts pre-trained vision transfo…
Layer-Specific Prompt Fusion Discovery via Differentiable Search in Vision Foundation Models
Xi Xiao, Xingjian Li, Yunbei Zhang +7
Visual prompt tuning has emerged as a parameter-efficient fine-tuning approach for adapting large-scale Vision Transformers (ViTs) to downstream tasks. As its learnable prompts are…
Mind the Rarities: Can Rare Skin Diseases Be Reliably Diagnosed via Diagnostic Reasoning?
Yang Liu, Jiyao Yang, Hongjin Zhao +10
Large vision-language models (LVLMs) demonstrate strong performance in dermatology; however, evaluating diagnostic reasoning for rare conditions remains largely unexplored. Existin…
Beyond Medical Diagnostics: How Medical Multimodal Large Language Models Think in Space
Quoc-Huy Trinh, Xi Ding, Yang Liu +7
Visual spatial intelligence is critical for medical image interpretation, yet remains largely unexplored in Multimodal Large Language Models (MLLMs) for 3D imaging. This gap persis…
From Specialist to Generalist: Unlocking SAM's Learning Potential on Unlabeled Medical Images
Vi Vu, Thanh-Huy Nguyen, Tien-Thinh Nguyen +5
Foundation models like the Segment Anything Model (SAM) show strong generalization, yet adapting them to medical images remains difficult due to domain shift, scarce labels, and th…
DuetMatch: Harmonizing Semi-Supervised Brain MRI Segmentation via Decoupled Branch Optimization
Thanh-Huy Nguyen, Hoang-Thien Nguyen, Vi Vu +6
The limited availability of annotated data in medical imaging makes semi-supervised learning increasingly appealing for its ability to learn from imperfect supervision. Recently, t…
DiLO: Disentangled Latent Optimization for Learning Shape and Deformation in Grouped Deforming 3D Objects
Mostofa Rafid Uddin, Jana Armouti, Umong Sain +3
In this work, we propose a disentangled latent optimization-based method for parameterizing grouped deforming 3D objects into shape and deformation factors in an unsupervised manne…
Towards Foundation Models for Cryo-ET Subtomogram Analysis
Runmin Jiang, Wanyue Feng, Yuntian Yang +11
Cryo-electron tomography (cryo-ET) enables in situ visualization of macromolecular structures, where subtomogram analysis tasks such as classification, alignment, and averaging are…
Adaptive Knowledge Transferring with Switching Dual-Student Framework for Semi-Supervised Medical Image Segmentation
Hoang-Thien Nguyen, Thanh-Huy Nguyen, Ba-Thinh Lam +6
Teacher-student frameworks have emerged as a leading approach in semi-supervised medical image segmentation, demonstrating strong performance across various tasks. However, the lea…
Prompt-based Adaptation in Large-scale Vision Models: A Survey
Xi Xiao, Yunbei Zhang, Lin Zhao +12
In computer vision, Visual Prompting (VP) and Visual Prompt Tuning (VPT) have recently emerged as lightweight and effective alternatives to full fine-tuning for adapting large-scal…
TextCAM: Explaining Class Activation Map with Text
Qiming Zhao, Xingjian Li, Xiaoyu Cao +2
Deep neural networks (DNNs) have achieved remarkable success across domains but remain difficult to interpret, limiting their trustworthiness in high-stakes applications. This pape…
Semi-MoE: Mixture-of-Experts meets Semi-Supervised Histopathology Segmentation
Nguyen Lan Vi Vu, Thanh-Huy Nguyen, Thien Nguyen +4
Semi-supervised learning has been employed to alleviate the need for extensive labeled data for histopathology image segmentation, but existing methods struggle with noisy pseudo-l…
Describe Anything Model for Visual Question Answering on Text-rich Images
Yen-Linh Vu, Dinh-Thang Duong, Truong-Binh Duong +8
Recent progress has been made in region-aware vision-language modeling, particularly with the emergence of the Describe Anything Model (DAM). DAM is capable of generating detailed…
Visual Instance-aware Prompt Tuning
Xi Xiao, Yunbei Zhang, Xingjian Li +5
Visual Prompt Tuning (VPT) has emerged as a parameter-efficient fine-tuning paradigm for vision transformers, with conventional approaches utilizing dataset-level prompts that rema…
SaSi: A Self-augmented and Self-interpreted Deep Learning Approach for Few-shot Cryo-ET Particle Detection
Gokul Adethya, Bhanu Pratyush Mantha, Tianyang Wang +2
Cryo-electron tomography (cryo-ET) has emerged as a powerful technique for imaging macromolecular complexes in their near-native states. However, the localization of 3D particles i…
Describe Anything in Medical Images
Xi Xiao, Yunbei Zhang, Thanh-Huy Nguyen +10
Localized image captioning has made significant progress with models like the Describe Anything Model (DAM), which can generate detailed region-specific descriptions without explic…
CryoCCD: Conditional Cycle-consistent Diffusion with Biophysical Modeling for Cryo-EM Synthesis
Runmin Jiang, Genpei Zhang, Yuntian Yang +10
Single-particle cryo-electron microscopy (cryo-EM) has become a cornerstone of structural biology, enabling near-atomic resolution analysis of macromolecules through advanced compu…
AutoMiSeg: Automatic Medical Image Segmentation via Test-Time Adaptation of Foundation Models
Xingjian Li, Qifeng Wu, Adithya S. Ubaradka +6
Medical image segmentation is vital for clinical diagnosis, yet current deep learning methods often demand extensive expert effort, i.e., either through annotating large training d…
Visual Variational Autoencoder Prompt Tuning
Xi Xiao, Yunbei Zhang, Yanshuh Li +5
Parameter-efficient fine-tuning (PEFT) has emerged as a crucial approach for adapting large vision transformers to downstream tasks without the prohibitive computational costs of f…
Multimodal Generalized Category Discovery
Yuchang Su, Renping Zhou, Siyu Huang +4
Generalized Category Discovery (GCD) aims to classify inputs into both known and novel categories, a task crucial for open-world scientific discoveries. However, current GCD method…
Vox-UDA: Voxel-wise Unsupervised Domain Adaptation for Cryo-Electron Subtomogram Segmentation with Denoised Pseudo Labeling
Haoran Li, Xingjian Li, Jiahua Shi +6
Cryo-Electron Tomography (cryo-ET) is a 3D imaging technology facilitating the study of macromolecular structures at near-atomic resolution. Recent volumetric segmentation approach…
Robust Cross-Modal Knowledge Distillation for Unconstrained Videos
Wenke Xia, Xingjian Li, Andong Deng +3
Cross-modal distillation has been widely used to transfer knowledge across different modalities, enriching the representation of the target unimodal one. Recent studies highly rela…
Towards Inadequately Pre-trained Models in Transfer Learning
Andong Deng, Xingjian Li, Di Hu +3
Pre-training has been a popular learning paradigm in deep learning era, especially in annotation-insufficient scenario. Better ImageNet pre-trained models have been demonstrated, f…