149 citations · 370 across the 20 of their papers we have counts for
24 papers
Continual Facial Expression Recognition: A Benchmark
Nikhil Churamani, Tolga Dimlioglu, German I. Parisi +1
Understanding human affective behaviour, especially in the dynamics of real-world settings, requires Facial Expression Recognition (FER) models to continuously adapt to individual…
GRATIS: Deep Learning Graph Representation with Task-specific Topology and Multi-dimensional Edge Features
Siyang Song, Yuxin Song, Cheng Luo +7
Graph is powerful for representing various types of real-world data. The topology (edges' presence) and edges' features of a graph decides the message passing mechanism among verti…
An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognition
Rongfan Liao, Siyang Song, Hatice Gunes
Personality determines a wide variety of human daily and working behaviours, and is crucial for understanding human internal and external states. In recent years, a large number of…
Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognition
Cheng Luo, Siyang Song, Weicheng Xie +2
The activations of Facial Action Units (AUs) mutually influence one another. While the relationship between a pair of AUs can be complex and unique, existing approaches fail to spe…
The Effect of Model Compression on Fairness in Facial Expression Recognition
Samuil Stoychev, Hatice Gunes
Deep neural networks have proved hugely successful, achieving human-like performance on a variety of tasks. However, they are also computationally expensive, which has motivated th…
Dynamic Bayesian Network Modelling of User Affect and Perceptions of a Teleoperated Robot Coach during Longitudinal Mindfulness Training
Indu P. Bodala, Hatice Gunes
Longitudinal interaction studies with Socially Assistive Robots are crucial to ensure that the robot is relevant for long-term use and its perceptions are not prone to the novelty…
Two-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representation
Jiaqi Xu, Siyang Song, Keerthy Kusumam +2
Video-based automatic depression analysis provides a fast, objective and repeatable self-assessment solution, which has been widely developed in recent years. While depression clue…
Inferring User Facial Affect in Work-like Settings
Chaudhary Muhammad Aqdus Ilyas, Siyang Song, Hatice Gunes
Unlike the six basic emotions of happiness, sadness, fear, anger, disgust and surprise, modelling and predicting dimensional affect in terms of valence (positivity - negativity) an…
Learning Graph Representation of Person-specific Cognitive Processes from Audio-visual Behaviours for Automatic Personality Recognition
Siyang Song, Zilong Shao, Shashank Jaiswal +3
This approach builds on two following findings in cognitive science: (i) human cognition partially determines expressed behaviour and is directly linked to true personality traits;…
Toward Affective XAI: Facial Affect Analysis for Understanding Explainable Human-AI Interactions
Luke Guerdan, Alex Raymond, Hatice Gunes
As machine learning approaches are increasingly used to augment human decision-making, eXplainable Artificial Intelligence (XAI) research has explored methods for communicating sys…
Towards Fair Affective Robotics: Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
Ozgur Kara, Nikhil Churamani, Hatice Gunes
As affective robots become integral in human life, these agents must be able to fairly evaluate human affective expressions without discriminating against specific demographic grou…
Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
Nikhil Churamani, Ozgur Kara, Hatice Gunes
As Facial Expression Recognition (FER) systems become integrated into our daily lives, these systems need to prioritise making fair decisions instead of aiming at higher individual…
Spatio-Temporal Analysis of Facial Actions using Lifecycle-Aware Capsule Networks
Nikhil Churamani, Sinan Kalkan, Hatice Gunes
Most state-of-the-art approaches for Facial Action Unit (AU) detection rely upon evaluating facial expressions from static frames, encoding a snapshot of heightened facial activity…
Affect-Driven Modelling of Robot Personality for Collaborative Human-Robot Interactions
Nikhil Churamani, Pablo Barros, Hatice Gunes +1
Collaborative interactions require social robots to adapt to the dynamics of human affective behaviour. Yet, current approaches for affective behaviour generation in robots focus o…
Investigating Bias and Fairness in Facial Expression Recognition
Tian Xu, Jennifer White, Sinan Kalkan +1
Recognition of expressions of emotions and affect from facial images is a well-studied research problem in the fields of affective computing and computer vision with a large number…
Mind Your Manners! A Dataset and A Continual Learning Approach for Assessing Social Appropriateness of Robot Actions
Jonas Tjomsland, Sinan Kalkan, Hatice Gunes
To date, endowing robots with an ability to assess social appropriateness of their actions has not been possible. This has been mainly due to (i) the lack of relevant and labelled…
Creating a Robot Coach for Mindfulness and Wellbeing: A Longitudinal Study
Indu P. Bodala, Nikhil Churamani, Hatice Gunes
Social robots are starting to become incorporated into daily lives by assisting in the promotion of physical and mental wellbeing. This paper investigates the use of social robots…
Facial Electromyography-based Adaptive Virtual Reality Gaming for Cognitive Training
Lorcan Reidy, Dennis Chan, Charles Nduka +1
Cognitive training has shown promising results for delivering improvements in human cognition related to attention, problem solving, reading comprehension and information retrieval…
Culture-Based Explainable Human-Agent Deconfliction
Alex Raymond, Hatice Gunes, Amanda Prorok
Law codes and regulations help organise societies for centuries, and as AI systems gain more autonomy, we question how human-agent systems can operate as peers under the same norms…
Registration-free Face-SSD: Single shot analysis of smiles, facial attributes, and affect in the wild
Youngkyoon Jang, Hatice Gunes, Ioannis Patras
In this paper, we present a novel single shot face-related task analysis method, called Face-SSD, for detecting faces and for performing various face-related (classification/regres…
CNN-based Facial Affect Analysis on Mobile Devices
Charlie Hewitt, Hatice Gunes
This paper focuses on the design, deployment and evaluation of Convolutional Neural Network (CNN) architectures for facial affect analysis on mobile devices. Unlike traditional CNN…
An empirical approach to the relationship between emotion and music production quality
David Ronan, Joshua D. Reiss, Hatice Gunes
In music production, the role of the mix engineer is to take recorded music and convey the expressed emotions as professionally sounding as possible. We investigated the relationsh…
Automatic Minimisation of Masking in Multitrack Audio using Subgroups
David Ronan, Zheng Ma, Paul Mc Namara +2
The iterative process of masking minimisation when mixing multitrack audio is a challenging optimisation problem, in part due to the complexity and non-linearity of auditory percep…
Face Alignment Assisted by Head Pose Estimation
Heng Yang, Wenxuan Mou, Yichi Zhang +3
In this paper we propose a supervised initialization scheme for cascaded face alignment based on explicit head pose estimation. We first investigate the failure cases of most state…