7 papers
Not all Blends are Equal: The BLEMORE Dataset of Blended Emotion Expressions with Relative Salience Annotations
Tim Lachmann, Alexandra Israelsson, Christina Tornberg +4
Humans often experience not just a single basic emotion at a time, but rather a blend of several emotions with varying salience. Despite the importance of such blended emotions, mo…
CM3T: Framework for Efficient Multimodal Learning for Inhomogeneous Interaction Datasets
Tanay Agrawal, Mohammed Guermal, Michal Balazia +1
Challenges in cross-learning involve inhomogeneous or even inadequate amount of training data and lack of resources for retraining large pretrained models. Inspired by transfer lea…
MVP: Multimodal Emotion Recognition based on Video and Physiological Signals
Valeriya Strizhkova, Hadi Kachmar, Hava Chaptoukaev +9
Human emotions entail a complex set of behavioral, physiological and cognitive changes. Current state-of-the-art models fuse the behavioral and physiological components using class…
Identifying Surgical Instruments in Pedagogical Cataract Surgery Videos through an Optimized Aggregation Network
Sanya Sinha, Michal Balazia, Francois Bremond
Instructional cataract surgery videos are crucial for ophthalmologists and trainees to observe surgical details repeatedly. This paper presents a deep learning model for real-time…
Introducing Gating and Context into Temporal Action Detection
Aglind Reka, Diana Laura Borza, Dominick Reilly +2
Temporal Action Detection (TAD), the task of localizing and classifying actions in untrimmed video, remains challenging due to action overlaps and variable action durations. Recent…
MultiMediate'24: Multi-Domain Engagement Estimation
Philipp Müller, Michal Balazia, Tobias Baur +8
Estimating the momentary level of participant's engagement is an important prerequisite for assistive systems that support human interactions. Previous work has addressed this task…