2 citations · 4 across the 7 of their papers we have counts for
7 papers
Bootstrapping Audiovisual Speech Recognition in Zero-AV-Resource Scenarios
Pol Buitrago, Pol Gàlvez, Oriol Pareras +1
Audiovisual speech recognition (AVSR) combines acoustic and visual cues to improve transcription robustness under challenging conditions but remains out of reach for most under-res…
Quantifying Cross-Lingual Transfer in Paralinguistic Speech Tasks
Pol Buitrago, Oriol Pareras, Federico Costa +1
Paralinguistic speech tasks are often considered relatively language-agnostic, as they rely on extralinguistic acoustic cues rather than lexical content. However, prior studies rep…
Listening or Reading? Evaluating Speech Awareness in Chain-of-Thought Speech-to-Text Translation
Jacobo Romero-Díaz, Gerard I. Gállego, Oriol Pareras +3
Speech-to-Text Translation (S2TT) systems built from Automatic Speech Recognition (ASR) and Text-to-Text Translation (T2TT) modules face two major limitations: error propagation an…
Revisiting Direct Speech-to-Text Translation with Speech LLMs: Better Scaling than CoT Prompting?
Oriol Pareras, Gerard I. Gállego, Federico Costa +2
Recent work on Speech-to-Text Translation (S2TT) has focused on LLM-based models, introducing the increasingly adopted Chain-of-Thought (CoT) prompting, where the model is guided t…
Speech-to-Text Translation with Phoneme-Augmented CoT: Enhancing Cross-Lingual Transfer in Low-Resource Scenarios
Gerard I. Gállego, Oriol Pareras, Martí Cortada Garcia +2
We propose a Speech-to-Text Translation (S2TT) approach that integrates phoneme representations into a Chain-of-Thought (CoT) framework to improve translation in low-resource and z…
Breaking Language Barriers in Visual Language Models via Multilingual Textual Regularization
Iñigo Pikabea, Iñaki Lacunza, Oriol Pareras +4
Rapid advancements in Visual Language Models (VLMs) have transformed multimodal understanding but are often constrained by generating English responses regardless of the input lang…
Salamandra Technical Report
Aitor Gonzalez-Agirre, Marc Pàmies, Joan Llop +21
This work introduces Salamandra, a suite of open-source decoder-only large language models available in three different sizes: 2, 7, and 40 billion parameters. The models were trai…