FALCON: False-Negative Aware Learning of Contrastive Negatives in Vision-Language Alignment

Myunsoo Kim, Seongwoong Shim, Byung-Jun Lee

False negatives pose a critical challenge in vision-language pretraining (VLP) due to the many-to-many correspondence between images and texts in large-scale datasets. These false…