IoT Data Analytics in Dynamic Environments: From An Automated Machine Learning Perspective

Abstract

With the wide spread of sensors and smart devices in recent years, the data generation speed of the Internet of Things (IoT) systems has increased dramatically. In IoT systems, massive volumes of data must be processed, transformed, and analyzed on a frequent basis to enable various IoT services and functionalities. Machine Learning (ML) approaches have shown their capacity for IoT data analytics. However, applying ML models to IoT data analytics tasks still faces many difficulties and challenges, specifically, effective model selection, design/tuning, and updating, which have brought massive demand for experienced data scientists. Additionally, the dynamic nature of IoT data may introduce concept drift issues, causing model performance degradation. To reduce human efforts, Automated Machine Learning (AutoML) has become a popular field that aims to automatically select, construct, tune, and update machine learning models to achieve the best performance on specified tasks. In this paper, we conduct a review of existing methods in the model selection, tuning, and updating procedures in the area of AutoML in order to identify and summarize the optimal solutions for every step of applying ML algorithms to IoT data analytics. To justify our findings and help industrial users and researchers better implement AutoML approaches, a case study of applying AutoML to IoT anomaly detection problems is conducted in this work. Lastly, we discuss and classify the challenges and research directions for this domain.

arXiv commentPublished in Engineering Applications of Artificial Intelligence (Elsevier, IF:7.8); Code/An AutoML tutorial is available at Github link: https://github.com/Western-OC2-Lab/AutoML-Implementation-for-Static-and-Dynamic-Data-Analytics

References in corpus (23)

• Scikit-learn: Machine Learning in Python
• SMOTE: Synthetic Minority Over-sampling Technique
• Practical Bayesian Optimization of Machine Learning Algorithms
• On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practice
• A Tutorial on Principal Component Analysis
• AutoML: A Survey of the State-of-the-Art
• Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization
• Learning under Concept Drift: A Review
• Machine learning for Internet of Things data analysis: A survey
• An Experimental Review on Deep Learning Architectures for Time Series Forecasting
• Machine Learning Based Solutions for Security of Internet of Things (IoT): A Survey
• MTH-IDS: A Multi-Tiered Hybrid Intrusion Detection System for Internet of Vehicles
• Multi-Stage Optimized Machine Learning Framework for Network Intrusion Detection
• Automated Machine Learning: From Principles to Practices
• Learning under Concept Drift: an Overview
• River: machine learning for streaming data in Python
• A Lightweight Concept Drift Detection and Adaptation Framework for IoT Data Streams
• A Transfer Learning and Optimized CNN Based Intrusion Detection System for Internet of Vehicles
• Machine Learning Towards Intelligent Systems: Applications, Challenges, and Opportunities
• PWPAE: An Ensemble Framework for Concept Drift Adaptation in IoT Data Streams
• A fast algorithm for computing distance correlation
• Multi-Perspective Content Delivery Networks Security Framework Using Optimized Unsupervised Anomaly Detection
• Automated Architecture Design for Deep Neural Networks

Cited by in corpus (4)

• Real-Time Adaptive Anomaly Detection in Industrial IoT Environments
• Enabling AutoML for Zero-Touch Network Security: Use-Case Driven Analysis
• Towards Zero Touch Networks: Cross-Layer Automated Security Solutions for 6G Wireless Networks
• Towards Autonomous Cybersecurity: An Intelligent AutoML Framework for Autonomous Intrusion Detection