Benchmarking Automatic Machine Learning Frameworks
arXiv:1808.06492
Abstract
AutoML serves as the bridge between varying levels of expertise when designing machine learning systems and expedites the data science process. A wide range of techniques is taken to address this, however there does not exist an objective comparison of these techniques. We present a benchmark of current open source AutoML solutions using open source datasets. We test auto-sklearn, TPOT, auto_ml, and H2O's AutoML solution against a compiled set of regression and classification datasets sourced from OpenML and find that auto-sklearn performs the best across classification datasets and TPOT performs the best across regression datasets.
arXiv comment9 pages, 8 figures, 5 tables
Cited by in corpus (8)
- Automated machine learning: AI-driven decision making in business analytics
- Towards Green Automated Machine Learning: Status Quo and Future Directions
- An Open Source AutoML Benchmark
- Assessing the Use of AutoML for Data-Driven Software Engineering
- Automated Machine Learning with Monte-Carlo Tree Search
- A Neophyte With AutoML: Evaluating the Promises of Automatic Machine Learning Tools
- Post-processing Multi-Model Medium-Term Precipitation Forecasts Using Convolutional Neural Networks
- Prediction of properties of metal alloy materials based on machine learning