8 citations · 26 across the 25 of their papers we have counts for
25 papers
CoughPhase-CLR: Designing an acoustics-informed foundation model for coughing sound classification
Marius Moldovan, Anton Batliner, Thomas M. Berghaus +2
In this work, we introduce CoughPhase-CLR, a self-supervised learning framework designed to leverage the physiological phases of a cough for robust representation learning. Unlike…
Acoustic Cue Alignment in Audio Language Models for Speech Emotion Recognition
Iosif Tsangko, Andreas Triantafyllopoulos, Björn W. Schuller
Instruction-following audio language models (ALMs) can be augmented with explicit acoustic cues, yet it remains unclear whether such cues are used in a grounded way when the raw au…
A Pilot Study on Curator-Guided Multilingual Art Description for Blind and Low-Vision Audiences with Small Vision-Language Models
Iosif Tsangko, Andreas Triantafyllopoulos, George Margetis +2
Blind and low-vision (BLV) audiences remain underserved by visual art descriptions, particularly across languages and in museum settings where privacy and intellectual-property con…
CoarseSoundNet: Building a reliable model for ecological soundscape analysis
Alexander Gebhard, Andreas Triantafyllopoulos, Dominik Arend +4
A soundscape is composed of three types of sound: biophony (sounds made by animals), geophony (natural abiotic sounds) and anthropophony (sounds made by humans). A key research que…
A conceptual framework for learning to listen by reward: Curiosity-driven search for novel sources
Andreas Triantafyllopoulos, Jakub Šťastný, Alexios Terpinas +3
Reinforcement learning is a powerful learning paradigm that has spearheaded progress in numerous domains. Its core promise lies in learning through high-level goals without the nee…
EmoSURA: Towards Accurate Evaluation of Detailed and Long-Context Emotional Speech Captions
Xin Jing, Andreas Triantafyllopoulos, Jiadong Wang +3
Recent advancements in speech captioning models have enabled the generation of rich, fine-grained captions for emotional speech. However, the evaluation of such captions remains a…
How Class Ontology and Data Scale Affect Audio Transfer Learning
Manuel Milling, Andreas Triantafyllopoulos, Alexander Gebhard +2
Transfer learning is a crucial concept within deep learning that allows artificial neural networks to benefit from a large pre-training data basis when confronted with a task of li…
SmoothCLAP: Soft-Target Enhanced Contrastive Language\--Audio Pretraining for Affective Computing
Xin Jing, Jiadong Wang, Andreas Triantafyllopoulos +4
The ambiguity of human emotions poses several challenges for machine learning models, as they often overlap and lack clear delineating boundaries. Contrastive language-audio pretra…
Detecting COPD Through Speech Analysis: A Dataset of Danish Speech and Machine Learning Approach
Cuno Sankey-Olsen, Rasmus Hvass Olesen, Tobias Oliver Eberhard +3
Chronic Obstructive Pulmonary Disease (COPD) is a serious and debilitating disease affecting millions around the world. Its early detection using non-invasive means could enable pr…
Reading Smiles: Proxy Bias in Foundation Models for Facial Emotion Recognition
Iosif Tsangko, Andreas Triantafyllopoulos, Adem Abdelmoula +2
Foundation Models (FMs) are rapidly transforming Affective Computing (AC), with Vision Language Models (VLMs) now capable of recognising emotions in zero shot settings. This paper…
MELT: Towards Automated Multimodal Emotion Data Annotation by Leveraging LLM Embedded Knowledge
Xin Jing, Jiadong Wang, Iosif Tsangko +2
Although speech emotion recognition (SER) has advanced significantly with deep learning, annotation remains a major hurdle. Human annotation is not only costly but also subject to…
ECOSoundSet: a finely annotated dataset for the automated acoustic identification of Orthoptera and Cicadidae in North, Central and temperate Western Europe
David Funosas, Elodie Massol, Yves Bas +23
Currently available tools for the automated acoustic recognition of European insects in natural soundscapes are limited in scope. Large and ecologically heterogeneous acoustic data…
DFingerNet: Noise-Adaptive Speech Enhancement for Hearing Aids
Iosif Tsangko, Andreas Triantafyllopoulos, Michael Müller +2
The DeepFilterNet (DFN) architecture was recently proposed as a deep learning model suited for hearing aid devices. Despite its competitive performance on numerous benchmarks, it s…
Enhancing Emotional Text-to-Speech Controllability with Natural Language Guidance through Contrastive Learning and Diffusion Models
Xin Jing, Kun Zhou, Andreas Triantafyllopoulos +1
While current emotional text-to-speech (TTS) systems can generate highly intelligible emotional speech, achieving fine control over emotion rendering of the output speech still rem…
Audio Enhancement for Computer Audition -- An Iterative Training Paradigm Using Sample Importance
Manuel Milling, Shuo Liu, Andreas Triantafyllopoulos +2
Neural network models for audio tasks, such as automatic speech recognition (ASR) and acoustic scene classification (ASC), are susceptible to noise contamination for real-life appl…
Computer Audition: From Task-Specific Machine Learning to Foundation Models
Andreas Triantafyllopoulos, Iosif Tsangko, Alexander Gebhard +3
Foundation models (FMs) are increasingly spearheading recent advances on a variety of tasks that fall under the purview of computer audition -- the use of machines to understand so…
ParaCLAP -- Towards a general language-audio model for computational paralinguistic tasks
Xin Jing, Andreas Triantafyllopoulos, Björn Schuller
Contrastive language-audio pretraining (CLAP) has recently emerged as a method for making audio analysis more generalisable. Specifically, CLAP-style models are able to `answer' a…
Enrolment-based personalisation for improving individual-level fairness in speech emotion recognition
Andreas Triantafyllopoulos, Björn Schuller
The expression of emotion is highly individualistic. However, contemporary speech emotion recognition (SER) systems typically rely on population-level models that adopt a `one-size…
Sustained Vowels for Pre- vs Post-Treatment COPD Classification
Andreas Triantafyllopoulos, Anton Batliner, Wolfgang Mayr +6
Chronic obstructive pulmonary disease (COPD) is a serious inflammatory lung disease affecting millions of people around the world. Due to an obstructed airflow from the lungs, it a…
Audio-based Step-count Estimation for Running -- Windowing and Neural Network Baselines
Philipp Wagner, Andreas Triantafyllopoulos, Alexander Gebhard +1
In recent decades, running has become an increasingly popular pastime activity due to its accessibility, ease of practice, and anticipated health benefits. However, the risk of run…
An automatic analysis of ultrasound vocalisations for the prediction of interaction context in captive Egyptian fruit bats
Andreas Triantafyllopoulos, Alexander Gebhard, Manuel Milling +2
Prior work in computational bioacoustics has mostly focused on the detection of animal presence in a particular habitat. However, animal sounds contain much richer information than…
Expressivity and Speech Synthesis
Andreas Triantafyllopoulos, Björn W. Schuller
Imbuing machines with the ability to talk has been a longtime pursuit of artificial intelligence (AI) research. From the very beginning, the community has not only aimed to synthes…
Self-Supervised Attention Networks and Uncertainty Loss Weighting for Multi-Task Emotion Recognition on Vocal Bursts
Vincent Karas, Andreas Triantafyllopoulos, Meishu Song +1
Vocal bursts play an important role in communicating affect, making them valuable for improving speech emotion recognition. Here, we present our approach for classifying vocal burs…
Distinguishing between pre- and post-treatment in the speech of patients with chronic obstructive pulmonary disease
Andreas Triantafyllopoulos, Markus Fendler, Anton Batliner +4
Chronic obstructive pulmonary disease (COPD) causes lung inflammation and airflow blockage leading to a variety of respiratory symptoms; it is also a leading cause of death and aff…