5 papers
A Benchmark for Audio Reasoning Capabilities of Multimodal Large Language Models
Iwona Christop, Mateusz Czyżnikiewicz, Paweł Skórzewski +4
The present benchmarks for testing the audio modality of multimodal large language models concentrate on testing various audio tasks such as speaker diarization or gender identific…
Preservation of Language Understanding Capabilities in Speech-aware Large Language Models
Marek Kubis, Paweł Skórzewski, Iwona Christop +4
The paper presents C3T (Cross-modal Capabilities Conservation Test), a new benchmark for assessing the performance of speech-aware large language models. The benchmark utilizes tex…
LoRP-TTS: Low-Rank Personalized Text-To-Speech
Łukasz Bondaruk, Jakub Kubiak
Speech synthesis models convert written text into natural-sounding audio. While earlier models were limited to a single speaker, recent advancements have led to the development of…
Augmenting Polish Automatic Speech Recognition System With Synthetic Data
Łukasz Bondaruk, Jakub Kubiak, Mateusz Czyżnikiewicz
This paper presents a system developed for submission to Poleval 2024, Task 3: Polish Automatic Speech Recognition Challenge. We describe Voicebox-based speech synthesis pipeline a…
Spoken Language Corpora Augmentation with Domain-Specific Voice-Cloned Speech
Mateusz Czyżnikiewicz, Łukasz Bondaruk, Jakub Kubiak +4
In this paper we study the impact of augmenting spoken language corpora with domain-specific synthetic samples for the purpose of training a speech recognition system. Using both a…