Complex Daily Activities, Country-Level Diversity, and Smartphone Sensing: A Study in Denmark, Italy, Mongolia, Paraguay, and UK

Abstract

Smartphones enable understanding human behavior with activity recognition to support people's daily lives. Prior studies focused on using inertial sensors to detect simple activities (sitting, walking, running, etc.) and were mostly conducted in homogeneous populations within a country. However, people are more sedentary in the post-pandemic world with the prevalence of remote/hybrid work/study settings, making detecting simple activities less meaningful for context-aware applications. Hence, the understanding of (i) how multimodal smartphone sensors and machine learning models could be used to detect complex daily activities that can better inform about people's daily lives and (ii) how models generalize to unseen countries, is limited. We analyzed in-the-wild smartphone data and over 216K self-reports from 637 college students in five countries (Italy, Mongolia, UK, Denmark, Paraguay). Then, we defined a 12-class complex daily activity recognition task and evaluated the performance with different approaches. We found that even though the generic multi-country approach provided an AUROC of 0.70, the country-specific approach performed better with AUROC scores in [0.79-0.89]. We believe that research along the lines of diversity awareness is fundamental for advancing human behavior understanding through smartphones and machine learning, for more real-world utility across countries.

arXiv commentACM CHI 2023

References in corpus (11)

• Diversity in Machine Learning
• An Overview of Human Activity Recognition Using Wearable Sensors: Healthcare and Artificial Intelligence
• Cultural Incongruencies in Artificial Intelligence
• Modeling Personality vs. Modeling Personalidad: In-the-wild Mobile Data Analysis in Five Countries Suggests Cultural Impact on Personality Models
• Smartphone Sensing for the Well-being of Young Adults: A Review
• The Theory, Practice, and Ethical Challenges of Designing a Diversity-Aware Platform for Social Relations
• Examining the Social Context of Alcohol Drinking in Young Adults with Smartphone Sensing
• Alone or With Others? Understanding Eating Episodes of College Students with Mobile Sensing
• Sensing Eating Events in Context: A Smartphone-Only Approach
• Self-supervised Pretraining and Transfer Learning Enable Flu and COVID-19 Predictions in Small Mobile Sensing Datasets
• Domain Adaptation Under Behavioral and Temporal Shifts for Natural Time Series Mobile Activity Recognition

Cited by in corpus (3)

• M3BAT: Unsupervised Domain Adaptation for Multimodal Mobile Sensing with Multi-Branch Adversarial Training
• DiversityOne: A Multi-Country Smartphone Sensor Dataset for Everyday Life Behavior Modeling
• Understanding the Social Context of Eating with Multimodal Smartphone Sensing: The Role of Country Diversity