Aligning Medical Images with General Knowledge from Large Language Models

Xiao Fang, Yi Lin, Dong Zhang +2

Pre-trained large vision-language models (VLMs) like CLIP have revolutionized visual representation learning using natural language as supervisions, and demonstrated promising gene…