Recommender systems and reinforcement learning for human-building interaction and context-aware support: A text mining-driven review of scientific literature

Abstract

The indoor environment significantly impacts human health and well-being; enhancing health and reducing energy consumption in these settings is a central research focus. With the advancement of Information and Communication Technology (ICT), recommendation systems and reinforcement learning (RL) have emerged as promising approaches to induce behavioral changes to improve the indoor environment and energy efficiency of buildings. This study aims to employ text mining and Natural Language Processing (NLP) techniques to thoroughly examine the connections among these approaches in the context of human-building interaction and occupant context-aware support. The study analyzed 27,595 articles from the ScienceDirect database, revealing extensive use of recommendation systems and RL for space optimization, location recommendations, and personalized control suggestions. Furthermore, this review underscores the vast potential for expanding recommender systems and RL applications in buildings and indoor environments. Fields ripe for innovation include predictive maintenance, building-related product recommendation, and optimization of environments tailored for specific needs, such as sleep and productivity enhancements based on user feedback. The study also notes the limitations of the method in capturing subtle academic nuances. Future improvements could involve integrating and fine-tuning pre-trained language models to better interpret complex texts.

References in corpus (16)

• Scikit-learn: Machine Learning in Python
• Efficient Estimation of Word Representations in Vector Space
• LLaMA: Open and Efficient Foundation Language Models
• NLTK: The Natural Language Toolkit
• BERTopic: Neural topic modeling with a class-based TF-IDF procedure
• Deep Reinforcement Learning for Multi-Agent Systems: A Review of Challenges, Solutions and Applications
• Text mining and visualization using VOSviewer
• A Review of Deep Reinforcement Learning for Smart Building Energy Management
• A Model of a Trust-based Recommendation System on a Social Network
• Hybrid Recommender Systems: A Systematic Literature Review
• The emergence of Explainability of Intelligent Systems: Delivering Explainable and Personalised Recommendations for Energy Efficiency
• Cohort comfort models -- Using occupants' similarity to predict personal thermal preference with less data
• Cozie Apple: An iOS mobile and smartwatch application for environmental quality satisfaction and physiological data collection
• Personalized HeartSteps: A Reinforcement Learning Algorithm for Optimizing Physical Activity
• Large Language Models Offer an Alternative to the Traditional Approach of Topic Modelling
• Natural Language Processing via LDA Topic Model in Recommendation Systems