2 papers
cs.CV2019
Joint Wasserstein Autoencoders for Aligning Multimodal Embeddings
Shweta Mahajan, Teresa Botschen, Iryna Gurevych +1
One of the key challenges in learning joint embeddings of multiple modalities, e.g. of images and text, is to ensure coherent cross-modal semantics that generalize across datasets.…
cs.CL2018
Multimodal Grounding for Language Processing
Lisa Beinborn, Teresa Botschen, Iryna Gurevych
This survey discusses how recent developments in multimodal processing facilitate conceptual grounding of language. We categorize the information flow in multimodal processing with…