5 papers
Dual Prompt Learning for Adapting Vision-Language Models to Downstream Image-Text Retrieval
Yifan Wang, Tao Wang, Chenwei Tang +5
Recently, prompt learning has demonstrated remarkable success in adapting pre-trained Vision-Language Models (VLMs) to various downstream tasks such as image classification. Howeve…
Aligning Information Capacity Between Vision and Language via Dense-to-Sparse Feature Distillation for Image-Text Matching
Yang Liu, Wentao Feng, Zhuoyao Liu +2
Enabling Visual Semantic Models to effectively handle multi-view description matching has been a longstanding challenge. Existing methods typically learn a set of embeddings to fin…
Asymmetric Visual Semantic Embedding Framework for Efficient Vision-Language Alignment
Yang Liu, Mengyuan Liu, Shudong Huang +1
Learning visual semantic similarity is a critical challenge in bridging the gap between images and texts. However, there exist inherent variations between vision and language data,…
Multi-view Granular-ball Contrastive Clustering
Peng Su, Shudong Huang, Weihong Ma +2
Previous multi-view contrastive learning methods typically operate at two scales: instance-level and cluster-level. Instance-level approaches construct positive and negative pairs…
DrugLLM: Open Large Language Model for Few-shot Molecule Generation
Xianggen Liu, Yan Guo, Haoran Li +4
Large Language Models (LLMs) have made great strides in areas such as language processing and computer vision. Despite the emergence of diverse techniques to improve few-shot learn…