2 papers
cs.SD2026
A Benchmark for Audio Reasoning Capabilities of Multimodal Large Language Models
Iwona Christop, Mateusz Czyżnikiewicz, PaweŠSkórzewski +4
The present benchmarks for testing the audio modality of multimodal large language models concentrate on testing various audio tasks such as speaker diarization or gender identific…
cs.CL2025
Preservation of Language Understanding Capabilities in Speech-aware Large Language Models
Marek Kubis, PaweŠSkórzewski, Iwona Christop +4
The paper presents C3T (Cross-modal Capabilities Conservation Test), a new benchmark for assessing the performance of speech-aware large language models. The benchmark utilizes tex…