204 citations · 426 across the 23 of their papers we have counts for
27 papers
Micro-Expression-Aware Avatar Fingerprinting via Inter-Frame Feature Differencing
Masoumeh Chapariniya, Jean-Marc Odobez, Volker Dellwo +1
Avatar fingerprinting, i.e., verifying who drives a synthetic talking-head video rather than whether it is real, is a critical safeguard for authorized use of face-reenactment tech…
End-to-End Shared Attention Estimation via Group Detection with Feedback Refinement
Chihiro Nakatani, Norimichi Ukita, Jean-Marc Odobez
This paper proposes an end-to-end shared attention estimation method via group detection. Most previous methods estimate shared attention (SA) without detecting the actual group of…
Investigating Identity Signals in Conversational Facial Dynamics via Disentangled Expression Features
Masoumeh Chapariniya, Pierre Vuillecard, Jean-Marc Odobez +2
This work investigates whether individuals can be identified solely through the pure dynamical components of their facial expressions, independent of static facial appearance. We l…
Enhancing 3D Gaze Estimation in the Wild using Weak Supervision with Gaze Following Labels
Pierre Vuillecard, Jean-Marc Odobez
Accurate 3D gaze estimation in unconstrained real-world environments remains a significant challenge due to variations in appearance, head pose, occlusion, and the limited availabi…
Giving Sense to Inputs: Toward an Accessible Control Framework for Shared Autonomy
Shalutha Rajapakshe, Jean-Marc Odobez, Emmanuel Senft
While shared autonomy offers significant potential for assistive robotics, key questions remain about how to effectively map 2D control inputs to 6D robot motions. An intuitive fra…
Loose Social-Interaction Recognition in Real-world Therapy Scenarios
Abid Ali, Rui Dai, Ashish Marisetty +5
The computer vision community has explored dyadic interactions for atomic actions such as pushing, carrying-object, etc. However, with the advancement in deep learning models, ther…
ChildPlay-Hand: A Dataset of Hand Manipulations in the Wild
Arya Farkhondeh, Samy Tafasca, Jean-Marc Odobez
Hand-Object Interaction (HOI) is gaining significant attention, particularly with the creation of numerous egocentric datasets driven by AR/VR applications. However, third-person v…
Weakly-supervised Autism Severity Assessment in Long Videos
Abid Ali, Mahmoud Ali, Jean-Marc Odobez +4
Autism Spectrum Disorder (ASD) is a diverse collection of neurobiological conditions marked by challenges in social communication and reciprocal interactions, as well as repetitive…
Exploring the Zero-Shot Capabilities of Vision-Language Models for Improving Gaze Following
Anshul Gupta, Pierre Vuillecard, Arya Farkhondeh +1
Contextual cues related to a person's pose and interactions with objects and other people in the scene can provide valuable information for gaze following. While existing methods h…
GeoSACS: Geometric Shared Autonomy via Canal Surfaces
Shalutha Rajapakshe, Atharva Dastenavar, Michael Hagenow +2
We introduce GeoSACS, a geometric framework for shared autonomy (SA). In variable environments, SA methods can be used to combine robotic capabilities with real-time human input in…
A Novel Framework for Multi-Person Temporal Gaze Following and Social Gaze Prediction
Anshul Gupta, Samy Tafasca, Arya Farkhondeh +2
Gaze following and social gaze prediction are fundamental tasks providing insights into human communication behaviors, intent, and social interactions. Most previous approaches add…
Sharingan: A Transformer-based Architecture for Gaze Following
Samy Tafasca, Anshul Gupta, Jean-Marc Odobez
Gaze is a powerful form of non-verbal communication and social interaction that humans develop from an early age. As such, modeling this behavior is an important task that can bene…
A Modular Multimodal Architecture for Gaze Target Prediction: Application to Privacy-Sensitive Settings
Anshul Gupta, Samy Tafasca, Jean-Marc Odobez
Predicting where a person is looking is a complex task, requiring to understand not only the person's gaze and scene content, but also the 3D scene structure and the person's situa…
ChildPlay: A New Benchmark for Understanding Children's Gaze Behaviour
Samy Tafasca, Anshul Gupta, Jean-Marc Odobez
Gaze behaviors such as eye-contact or shared attention are important markers for diagnosing developmental disorders in children. While previous studies have looked at some of these…
Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformers
Angel Martínez-González, Michael Villamizar, Jean-Marc Odobez
We propose to leverage Transformer architectures for non-autoregressive human motion prediction. Our approach decodes elements in parallel from a query sequence, instead of conditi…
An Efficient Image-to-Image Translation HourGlass-based Architecture for Object Pushing Policy Learning
Marco Ewerton, Angel Martínez-González, Jean-Marc Odobez
Humans effortlessly solve pushing tasks in everyday life but unlocking these capabilities remains a challenge in robotics because physics models of these tasks are often inaccurate…
IEEE SLT 2021 Alpha-mini Speech Challenge: Open Datasets, Tracks, Rules and Baselines
Yihui Fu, Zhuoyuan Yao, Weipeng He +9
The IEEE Spoken Language Technology Workshop (SLT) 2021 Alpha-mini Speech Challenge (ASC) is intended to improve research on keyword spotting (KWS) and sound source location (SSL)…
Residual Pose: A Decoupled Approach for Depth-based 3D Human Pose Estimation
Angel Martínez-González, Michael Villamizar, Olivier Canévet +1
We propose to leverage recent advances in reliable 2D pose estimation with Convolutional Neural Networks (CNN) to estimate the 3D pose of people from depth images in multi-person H…
Efficient Convolutional Neural Networks for Depth-Based Multi-Person Pose Estimation
Angel Martínez-González, Michael Villamizar, Olivier Canévet +1
Achieving robust multi-person 2D body landmark localization and pose estimation is essential for human behavior and interaction understanding as encountered for instance in HRI set…
Unsupervised Representation Learning for Gaze Estimation
Yu Yu, Jean-Marc Odobez
Although automatic gaze estimation is very important to a large variety of application areas, it is difficult to train accurate and robust gaze models, in great part due to the dif…
Real-time Convolutional Networks for Depth-based Human Pose Estimation
Angel Martínez-González, Michael Villamizar, Olivier Canévet +1
We propose to combine recent Convolutional Neural Networks (CNN) models with depth imaging to obtain a reliable and fast multi-person pose estimation algorithm applicable to Human…
MuMMER: Socially Intelligent Human-Robot Interaction in Public Spaces
Mary Ellen Foster, Bart Craenen, Amol Deshmukh +27
In the EU-funded MuMMER project, we have developed a social robot designed to interact naturally and flexibly with users in public spaces such as a shopping mall. We present the la…
Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis
Yu Yu, Gang Liu, Jean-Marc Odobez
As an indicator of human attention gaze is a subtle behavioral cue which can be exploited in many applications. However, inferring 3D gaze direction is challenging even for deep ne…
A Differential Approach for Gaze Estimation
Gang Liu, Yu Yu, Kenneth A. Funes Mora +1
Non-invasive gaze estimation methods usually regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye s…