77 citations · 81 across the 15 of their papers we have counts for
5 papers · 1 filter
Foundation Model Hidden Representations for Heart Rate Estimation from Auscultation
Jingping Nie, Dung T. Tran, Karan Thakkar +5
Auscultation, particularly heart sound, is a non-invasive technique that provides essential vital sign information. Recently, self-supervised acoustic representation foundation mod…
Modeling speech emotion with label variance and analyzing performance across speakers and unseen acoustic conditions
Vikramjit Mitra, Amrit Romana, Dung T. Tran +1
Spontaneous speech emotion data usually contain perceptual grades where graders assign emotion score after listening to the speech files. Such perceptual grades introduce uncertain…
Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram
Jingping Nie, Ran Liu, Behrooz Mahasseni +2
Acoustic signals are crucial for health monitoring, particularly heart sounds which provide essential data like heart rate and detect cardiac anomalies such as murmurs. This study…
Pre-Trained Foundation Model representations to uncover Breathing patterns in Speech
Vikramjit Mitra, Anirban Chatterjee, Ke Zhai +6
The process of human speech production involves coordinated respiratory action to elicit acoustic speech signals. Typically, speech is produced when air is forced from the lungs an…
Investigating salient representations and label Variance in Dimensional Speech Emotion Analysis
Vikramjit Mitra, Jingping Nie, Erdrin Azemi
Representations derived from models such as BERT (Bidirectional Encoder Representations from Transformers) and HuBERT (Hidden units BERT), have helped to achieve state-of-the-art p…