1 citations · 1 across the 11 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.CL2020
Direct multimodal few-shot learning of speech and images
Leanne Nortje, Herman Kamper
We propose direct multimodal few-shot models that learn a shared embedding space of spoken words and images from only a few paired examples. Imagine an agent is shown an image alon…
cs.CL2020
Unsupervised vs. transfer learning for multimodal one-shot matching of speech and images
Leanne Nortje, Herman Kamper
We consider the task of multimodal one-shot speech-image matching. An agent is shown a picture along with a spoken word describing the object in the picture, e.g. cookie, broccoli…
eess.AS2020
Vector-quantized neural networks for acoustic unit discovery in the ZeroSpeech 2020 challenge
Benjamin van Niekerk, Leanne Nortje, Herman Kamper
In this paper, we explore vector quantization for acoustic unit discovery. Leveraging unlabelled data, we aim to learn discrete representations of speech that separate phonetic con…