JECL: Joint Embedding and Cluster Learning for Image-Text Pairs

Sean T. Yang, Kuan-Hao Huang, Bill Howe

We propose JECL, a method for clustering image-caption pairs by training parallel encoders with regularized clustering and alignment objectives, simultaneously learning both repres…