4 papers
Beyond Graph Model: Reliable VLM Fine-Tuning via Random Graph Adapter
Bo Jiang, Xueyang Ze, Beibei Wang +3
Textual adapter-based tuning methods have shown significant potential in transferring knowledge from pre-trained Vision-Language Models (VLMs) to downstream tasks. Existing works g…
Integrated Structural Prompt Learning for Vision-Language Models
Jiahui Wang, Qin Xu, Bo Jiang +1
Prompt learning methods have significantly extended the transferability of pre-trained Vision-Language Models (VLMs) like CLIP for various downstream tasks. These methods adopt han…
Dynamic Rank Adaptation for Vision-Language Models
Jiahui Wang, Qin Xu, Bo Jiang +1
Pre-trained large vision-language models (VLMs) like CLIP demonstrate impressive generalization ability. Existing prompt-based and adapter-based works have made significant progres…
Harmonizing and Merging Source Models for CLIP-based Domain Generalization
Yuhe Ding, Jian Liang, Bo Jiang +3
CLIP-based domain generalization aims to improve model generalization to unseen domains by leveraging the powerful zero-shot classification capabilities of CLIP and multiple source…