Modeling Engagement in Long-Term, In-Home Socially Assistive Robot Interventions for Children with Autism Spectrum Disorders
arXiv:2002.02453 · doi:10.1126/scirobotics.aaz3791
Abstract
Socially assistive robotics (SAR) has great potential to provide accessible, affordable, and personalized therapeutic interventions for children with autism spectrum disorders (ASD). However, human-robot interaction (HRI) methods are still limited in their ability to autonomously recognize and respond to behavioral cues, especially in atypical users and everyday settings. This work applies supervised machine learning algorithms to model user engagement in the context of long-term, in-home SAR interventions for children with ASD. Specifically, we present two types of engagement models for each user: (i) generalized models trained on data from different users; and (ii) individualized models trained on an early subset of the user's data. The models achieved approximately 90% accuracy (AUROC) for post hoc binary classification of engagement, despite the high variance in data observed across users, sessions, and engagement states. Moreover, temporal patterns in model predictions could be used to reliably initiate re-engagement actions at appropriate times. These results validate the feasibility and challenges of recognition and response to user disengagement in long-term, real-world HRI settings. The contributions of this work also inform the design of engaging and personalized HRI, especially for the ASD community.
arXiv commentThis manuscript was published in Science Robotics on February 26, 2020
References in corpus (5)
- Scikit-learn: Machine Learning in Python
- XGBoost: A Scalable Tree Boosting System
- OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
- Personalized Machine Learning for Robot Perception of Affect and Engagement in Autism Therapy
- Long-Term Personalization of an In-Home Socially Assistive Robot for Children With Autism Spectrum Disorders
Cited by in corpus (4)
- MultiMediate'23: Engagement Estimation and Bodily Behaviour Recognition in Social Interactions
- UNICEF Guidance on AI for Children: Application to the Design of a Social Robot For and With Autistic Children
- MultiMediate'24: Multi-Domain Engagement Estimation
- Evaluating Temporal Patterns in Applied Infant Affect Recognition