Automated Evolutionary Approach for the Design of Composite Machine Learning Pipelines

Abstract

The effectiveness of the machine learning methods for real-world tasks depends on the proper structure of the modeling pipeline. The proposed approach is aimed to automate the design of composite machine learning pipelines, which is equivalent to computation workflows that consist of models and data operations. The approach combines key ideas of both automated machine learning and workflow management systems. It designs the pipelines with a customizable graph-based structure, analyzes the obtained results, and reproduces them. The evolutionary approach is used for the flexible identification of pipeline structure. The additional algorithms for sensitivity analysis, atomization, and hyperparameter tuning are implemented to improve the effectiveness of the approach. Also, the software implementation on this approach is presented as an open-source framework. The set of experiments is conducted for the different datasets and tasks (classification, regression, time series forecasting). The obtained results confirm the correctness and effectiveness of the proposed approach in the comparison with the state-of-the-art competitors and baseline solutions.

References in corpus (14)

• Scikit-learn: Machine Learning in Python
• Neural Architecture Search: A Survey
• AutoML: A Survey of the State-of-the-Art
• Evolution Strategies as a Scalable Alternative to Reinforcement Learning
• Tunability: Importance of Hyperparameters of Machine Learning Algorithms
• Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)
• AutoGluon-Tabular: Robust and Accurate AutoML for Structured Data
• AutoML-Zero: Evolving Machine Learning Algorithms From Scratch
• Limits of End-to-End Learning
• SepsisLab: Early Sepsis Prediction with Uncertainty Quantification and Active Sensing
• NASNet: A Neuron Attention Stage-by-Stage Net for Single Image Deraining
• A Conceptual Approach to Complex Model Management with Generalized Modelling Patterns and Evolutionary Identification
• Building a Reproducible Machine Learning Pipeline
• An Adaptive and Near Parameter-free Evolutionary Computation Approach Towards True Automation in AutoML

Cited by in corpus (4)

• Automated data processing and feature engineering for deep learning and big data applications: a survey
• Hybrid and Automated Machine Learning Approaches for Oil Fields Development: the Case Study of Volve Field, North Sea
• Data augmentation with automated machine learning: approaches and performance comparison with classical data augmentation methods
• Automated data-driven approach for gap filling in the time series using evolutionary learning