Large Language Models for Wearable Sensor-Based Human Activity Recognition, Health Monitoring, and Behavioral Modeling: A Survey of Early Trends, Datasets, and Challenges

Abstract

The proliferation of wearable technology enables the generation of vast amounts of sensor data, offering significant opportunities for advancements in health monitoring, activity recognition, and personalized medicine. However, the complexity and volume of this data present substantial challenges in data modeling and analysis, which have been tamed with approaches spanning time series modeling to deep learning techniques. The latest frontier in this domain is the adoption of Large Language Models (LLMs), such as GPT-4 and Llama, for data analysis, modeling, understanding, and generation of human behavior through the lens of wearable sensor data. This survey explores current trends and challenges in applying LLMs for sensor-based human activity recognition and behavior modeling. We discuss the nature of wearable sensors data, the capabilities and limitations of LLMs to model them and their integration with traditional machine learning techniques. We also identify key challenges, including data quality, computational requirements, interpretability, and privacy concerns. By examining case studies and successful applications, we highlight the potential of LLMs in enhancing the analysis and interpretation of wearable sensors data. Finally, we propose future directions for research, emphasizing the need for improved preprocessing techniques, more efficient and scalable models, and interdisciplinary collaboration. This survey aims to provide a comprehensive overview of the intersection between wearable sensors data and LLMs, offering insights into the current state and future prospects of this emerging field.

References in corpus (16)

• Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networks
• Trends in Workplace Wearable Technologies and Connected-Worker Solutions for Next-Generation Occupational Safety, Health, and Productivity
• Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
• The opportunities and risks of large language models in mental health
• GenAI Against Humanity: Nefarious Applications of Generative Artificial Intelligence and Large Language Models
• A Survey of Human Activity Recognition in Smart Homes Based on IoT Sensors Algorithms: Taxonomies, Challenges, and Opportunities with Deep Learning
• The Butterfly Effect in Artificial Intelligence Systems: Implications for AI Bias and Fairness
• TILES-2018, a longitudinal physiologic and behavioral data set of hospital workers
• From Explainable to Interpretable Deep Learning for Natural Language Processing in Healthcare: How Far from Reality?
• From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models
• MindShift: Leveraging Large Language Models for Mental-States-Based Problematic Smartphone Use Intervention
• Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homes
• Evaluating Large Language Models as Virtual Annotators for Time-series Physical Sensing Data
• Having a Bad Day? Detecting the Impact of Atypical Life Events Using Wearable Sensors
• Uncovering Bias in Personal Informatics
• Toward Pioneering Sensors and Features Using Large Language Models in Human Activity Recognition

Cited by in corpus (1)

• A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine