Automated Machine Learning in Practice: State of the Art and Recent Results

Abstract

A main driver behind the digitization of industry and society is the belief that data-driven model building and decision making can contribute to higher degrees of automation and more informed decisions. Building such models from data often involves the application of some form of machine learning. Thus, there is an ever growing demand in work force with the necessary skill set to do so. This demand has given rise to a new research topic concerned with fitting machine learning models fully automatically - AutoML. This paper gives an overview of the state of the art in AutoML with a focus on practical applicability in a business context, and provides recent benchmark results on the most important AutoML algorithms.

arXiv commentAccepted full paper at SDS2019, the 6th Swiss Conference on Data Science

References in corpus (13)

• Neural Architecture Search with Reinforcement Learning
• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
• AMC: AutoML for Model Compression and Acceleration on Mobile Devices
• OpenML: networked science in machine learning
• Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization
• Large-Scale Evolution of Image Classifiers
• Gradient-based Hyperparameter Optimization through Reversible Learning
• Population Based Training of Neural Networks
• Non-stochastic Best Arm Identification and Hyperparameter Optimization
• Simple And Efficient Architecture Search for Convolutional Neural Networks
• Learning to Learn without Gradient Descent by Gradient Descent
• Learning to Optimize
• Neural Networks for Predicting Algorithm Runtime Distributions

Cited by in corpus (5)

• Review of automated time series forecasting pipelines
• The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanations
• Data augmentation with automated machine learning: approaches and performance comparison with classical data augmentation methods
• Automating Generative Deep Learning for Artistic Purposes: Challenges and Opportunities
• Transfer Learning Based Automatic Model Creation Tool For Resource Constraint Devices