Practical Cross-modal Manifold Alignment for Grounded Language

Andre T. Nguyen, Luke E. Richards, Gaoussou Youssouf Kebe +4

We propose a cross-modality manifold alignment procedure that leverages triplet loss to jointly learn consistent, multi-modal embeddings of language-based concepts of real-world it…