Vision as an Interlingua: Learning Multilingual Semantic Embeddings of Untranscribed Speech

David Harwath, Galen Chuang, James Glass

In this paper, we explore the learning of neural network embeddings for natural images and speech waveforms describing the content of those images. These embeddings are learned dir…