37 citations · 91 across the 12 of their papers we have counts for
13 papers
Developing a foundation model for high-resolution remote sensing data of the Netherlands
Paul Vermeeren, Heysem Kaya
We develop a foundation model using 1.2m high resolution satellite images of the Netherlands. By combining a Convolutional Neural Network and a Vision Transformer, the model captur…
Audio-Visual Compound Expression Recognition Method based on Late Modality Fusion and Rule-based Decision
Elena Ryumina, Maxim Markitantov, Dmitry Ryumin +2
This paper presents the results of the SUN team for the Compound Expressions Recognition Challenge of the 6th ABAW Competition. We propose a novel audio-visual method for compound…
SUN Team's Contribution to ABAW 2024 Competition: Audio-visual Valence-Arousal Estimation and Expression Recognition
Denis Dresvyanskiy, Maxim Markitantov, Jiawei Yu +3
As emotions play a central role in human communication, automatic emotion recognition has attracted increasing attention in the last two decades. While multimodal systems enjoy hig…
Privacy Constrained Fairness Estimation for Decision Trees
Florian van der Steen, Fré Vink, Heysem Kaya
The protection of sensitive data becomes more vital, as data increases in value and potency. Furthermore, the pressure increases from regulators and society on model developers to…
The effects of gender bias in word embeddings on depression prediction
Gizem Sogancioglu, Heysem Kaya
Word embeddings are extensively used in various NLP problems as a state-of-the-art semantic feature vector representation. Despite their success on various tasks and domains, they…
Federated learning for violence incident prediction in a simulated cross-institutional psychiatric setting
Thomas Borger, Pablo Mosteiro, Heysem Kaya +4
Inpatient violence is a common and severe problem within psychiatry. Knowing who might become violent can influence staffing levels and mitigate severity. Predictive machine learni…
Speech Analysis for Automatic Mania Assessment in Bipolar Disorder
Pınar Baki, Heysem Kaya, Elvan Çiftçi +2
Bipolar disorder is a mental disorder that causes periods of manic and depressive episodes. In this work, we classify recordings from Bipolar Disorder corpus that contain 7 differe…
The INTERSPEECH 2021 Computational Paralinguistics Challenge: COVID-19 Cough, COVID-19 Speech, Escalation & Primates
Björn W. Schuller, Anton Batliner, Christian Bergler +21
The INTERSPEECH 2021 Computational Paralinguistics Challenge addresses four different problems for the first time in a research competition under well-defined conditions: In the CO…
Introducing a Central African Primate Vocalisation Dataset for Automated Species Classification
Joeri A. Zwerts, Jelle Treep, Casper S. Kaandorp +3
Automated classification of animal vocalisations is a potentially powerful wildlife monitoring tool. Training robust classifiers requires sizable annotated datasets, which are not…
An Audio-Video Deep and Transfer Learning Framework for Multimodal Emotion Recognition in the wild
Denis Dresvyanskiy, Elena Ryumina, Heysem Kaya +3
In this paper, we present our contribution to ABAW facial expression challenge. We report the proposed system and the official challenge results adhering to the challenge protocol.…
Is Everything Fine, Grandma? Acoustic and Linguistic Modeling for Robust Elderly Speech Emotion Recognition
Gizem Soğancıoğlu, Oxana Verkholyak, Heysem Kaya +4
Acoustic and linguistic analysis for elderly emotion recognition is an under-studied and challenging research direction, but essential for the creation of digital assistants for th…
Explaining First Impressions: Modeling, Recognizing, and Explaining Apparent Personality from Videos
Hugo Jair Escalante, Heysem Kaya, Albert Ali Salah +14
Explainability and interpretability are two critical aspects of decision support systems. Within computer vision, they are critical in certain tasks related to human behavior analy…
Adaptive Mixtures of Factor Analyzers
Heysem Kaya, Albert Ali Salah
A mixture of factor analyzers is a semi-parametric density estimator that generalizes the well-known mixtures of Gaussians model by allowing each Gaussian in the mixture to be repr…