111 citations · 462 across the 65 of their papers we have counts for
5 papers · 2 filters
Towards Learning to Speak and Hear Through Multi-Agent Communication over a Continuous Acoustic Channel
Kevin Eloff, Okko Räsänen, Herman A. Engelbrecht +2
Multi-agent reinforcement learning has been used as an effective means to study emergent communication between agents, yet little focus has been given to continuous acoustic commun…
Multilingual transfer of acoustic word embeddings improves when training on languages related to the target zero-resource language
Christiaan Jacobs, Herman Kamper
Acoustic word embedding models map variable duration speech segments to fixed dimensional vectors, enabling efficient speech search and discovery. Previous work explored how embedd…
Attention-Based Keyword Localisation in Speech using Visual Grounding
Kayode Olaleye, Herman Kamper
Visually grounded speech models learn from images paired with spoken captions. By tagging images with soft text labels using a trained visual classifier with a fixed vocabulary, pr…
Acoustic word embeddings for zero-resource languages using self-supervised contrastive learning and multilingual adaptation
Christiaan Jacobs, Yevgen Matusevych, Herman Kamper
Acoustic word embeddings (AWEs) are fixed-dimensional representations of variable-length speech segments. For zero-resource languages where labelled data is not available, one AWE…
A phonetic model of non-native spoken word processing
Yevgen Matusevych, Herman Kamper, Thomas Schatz +2
Non-native speakers show difficulties with spoken word processing. Many studies attribute these difficulties to imprecise phonological encoding of words in the lexical memory. We t…