7 citations · 11 across the 9 of their papers we have counts for
10 papers
Swivuriso: The South African Next Voices Multilingual Speech Dataset
Vukosi Marivate, Kayode Olaleye, Sitwala Mundia +19
This paper introduces Swivuriso, a 3000-hour multilingual speech dataset developed as part of the African Next Voices project, to support the development and benchmarking of automa…
Mafoko: Structuring and Building Open Multilingual Terminologies for South African NLP
Vukosi Marivate, Isheanesu Dzingirai, Fiskani Banda +9
The critical lack of structured terminological data for South Africa's official languages hampers progress in multilingual NLP, despite the existence of numerous government and aca…
AI and the Future of Work in Africa White Paper
Jacki O'Neill, Vukosi Marivate, Barbara Glover +71
This white paper is the output of a multidisciplinary workshop in Nairobi (Nov 2023). Led by a cross-organisational team including Microsoft Research, NEPAD, Lelapa AI, and Univers…
1000 African Voices: Advancing inclusive multi-speaker multi-accent speech synthesis
Sewade Ogun, Abraham T. Owodunni, Tobi Olatunji +6
Recent advances in speech synthesis have enabled many useful applications like audio directions in Google Maps, screen readers, and automated content generation on platforms like T…
Prompting Towards Alleviating Code-Switched Data Scarcity in Under-Resourced Languages with GPT as a Pivot
Michelle Terblanche, Kayode Olaleye, Vukosi Marivate
Many multilingual communities, including numerous in Africa, frequently engage in code-switching during conversations. This behaviour stresses the need for natural language process…
Visually Grounded Keyword Detection and Localisation for Low-Resource Languages
Kayode Kolawole Olaleye
This study investigates the use of Visually Grounded Speech (VGS) models for keyword localisation in speech. The study focusses on two main research questions: (1) Is keyword local…
YFACC: A Yorùbá speech-image dataset for cross-lingual keyword localisation through visual grounding
Kayode Olaleye, Dan Oneata, Herman Kamper
Visually grounded speech (VGS) models are trained on images paired with unlabelled spoken captions. Such models could be used to build speech systems in settings where it is imposs…
Keyword localisation in untranscribed speech using visually grounded speech models
Kayode Olaleye, Dan Oneata, Herman Kamper
Keyword localisation is the task of finding where in a speech utterance a given query keyword occurs. We investigate to what extent keyword localisation is possible using a visuall…
Attention-Based Keyword Localisation in Speech using Visual Grounding
Kayode Olaleye, Herman Kamper
Visually grounded speech models learn from images paired with spoken captions. By tagging images with soft text labels using a trained visual classifier with a fixed vocabulary, pr…
Towards localisation of keywords in speech using weak supervision
Kayode Olaleye, Benjamin van Niekerk, Herman Kamper
Developments in weakly supervised and self-supervised models could enable speech technology in low-resource settings where full transcriptions are not available. We consider whethe…