Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches

Abstract

Human activity recognition (HAR) using wearable sensors has advanced through various machine learning paradigms, each with inherent trade-offs between performance and labeling requirements. While fully supervised techniques achieve high accuracy, they demand extensive labeled datasets that are costly to obtain. Conversely, unsupervised methods eliminate labeling needs but often deliver suboptimal performance. This paper presents a comprehensive investigation across the supervision spectrum for wearable-based HAR, with particular focus on novel approaches that minimize labeling requirements while maintaining competitive accuracy. We develop and empirically compare: (1) traditional fully supervised learning, (2) basic unsupervised learning, (3) a weakly supervised learning approach with constraints, (4) a multi-task learning approach with knowledge sharing, (5) a self-supervised approach based on domain expertise, and (6) a novel weakly self-supervised learning framework that leverages domain knowledge and minimal labeled data. Experiments across benchmark datasets demonstrate that: (i) our weakly supervised methods achieve performance comparable to fully supervised approaches while significantly reducing supervision requirements; (ii) the proposed multi-task framework enhances performance through knowledge sharing between related tasks; (iii) our weakly self-supervised approach demonstrates remarkable efficiency with just 10\% of labeled data. These results not only highlight the complementary strengths of different learning paradigms, offering insights into tailoring HAR solutions based on the availability of labeled data, but also establish that our novel weakly self-supervised framework offers a promising solution for practical HAR applications where labeled data are limited.

References in corpus (19)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Character-level Convolutional Networks for Text Classification
• Deep Learning for Sensor-based Activity Recognition: A Survey
• InceptionTime: Finding AlexNet for Time Series Classification
• Contrastive Representation Learning: A Framework and Review
• Multiple Instance Learning: A Survey of Problem Characteristics and Applications
• A Time Series is Worth 64 Words: Long-term Forecasting with Transformers
• TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis
• Deep, Convolutional, and Recurrent Models for Human Activity Recognition using Wearables
• Multi-task Self-Supervised Learning for Human Activity Detection
• Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Data
• Predicting What You Already Know Helps: Provable Self-Supervised Learning
• Deep Transfer Learning with Graph Neural Network for Sensor-Based Human Activity Recognition
• Weakly Supervised Multi-Task Representation Learning for Human Activity Analysis Using Wearables
• Siamese Networks for Weakly Supervised Human Activity Recognition
• Unsupervised Embedding Learning for Human Activity Recognition Using Wearable Sensor Data
• Contrastive Learning for Many-to-many Multilingual Neural Machine Translation
• Efficient Deep Clustering of Human Activities and How to Improve Evaluation
• Consistency Based Weakly Self-Supervised Learning for Human Activity Recognition with Wearables