133 citations · 307 across the 28 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
cs.CL2017★ 24 cited
Encoding of phonology in a recurrent neural model of grounded speech
Afra Alishahi, Marie Barking, Grzegorz Chrupała
We study the representation and encoding of phonemes in a recurrent neural network model of grounded speech. We use a model which processes images and their spoken descriptions, an…
cs.CL2017★ 133 cited
Representations of language in a model of visually grounded speech signal
Grzegorz Chrupała, Lieke Gelderloos, Afra Alishahi
We present a visually grounded model of speech perception which projects spoken utterances and images to a joint semantic space. We use a multi-layer recurrent highway network to m…