Towards Automated Machine Learning: Evaluation and Comparison of AutoML Approaches and Tools

Abstract

There has been considerable growth and interest in industrial applications of machine learning (ML) in recent years. ML engineers, as a consequence, are in high demand across the industry, yet improving the efficiency of ML engineers remains a fundamental challenge. Automated machine learning (AutoML) has emerged as a way to save time and effort on repetitive tasks in ML pipelines, such as data pre-processing, feature engineering, model selection, hyperparameter optimization, and prediction result analysis. In this paper, we investigate the current state of AutoML tools aiming to automate these tasks. We conduct various evaluations of the tools on many datasets, in different data segments, to examine their performance, and compare their advantages and disadvantages on different test cases.

References in corpus (2)

• Neural Architecture Search with Reinforcement Learning
• OpenML: networked science in machine learning

Cited by in corpus (16)

• AutoGluon-Tabular: Robust and Accurate AutoML for Structured Data
• Automated machine learning: AI-driven decision making in business analytics
• Model fusion with physics-guided machine learning
• How Do UX Practitioners Communicate AI as a Design Material? Artifacts, Conceptions, and Propositions
• Machine Learning for the Detection and Identification of Internet of Things (IoT) Devices: A Survey
• Addressing UX Practitioners' Challenges in Designing ML Applications: an Interactive Machine Learning Approach
• Fast, Accurate, and Simple Models for Tabular Data via Augmented Distillation
• Testing the Robustness of AutoML Systems
• Automating Generative Deep Learning for Artistic Purposes: Challenges and Opportunities
• A Rigorous Machine Learning Analysis Pipeline for Biomedical Binary Classification: Application in Pancreatic Cancer Nested Case-control Studies with Implications for Bias Assessments
• Benchmarking Multimodal AutoML for Tabular Data with Text Fields
• Automated Machine Learning Techniques for Data Streams
• SIBILA: A novel interpretable ensemble of general-purpose machine learning models applied to medical contexts
• AIPerf: Automated machine learning as an AI-HPC benchmark
• A Survey on Proactive Customer Care: Enabling Science and Steps to Realize it
• Man versus Machine: AutoML and Human Experts' Role in Phishing Detection