One button machine for automating feature engineering in relational databases

Abstract

Feature engineering is one of the most important and time consuming tasks in predictive analytics projects. It involves understanding domain knowledge and data exploration to discover relevant hand-crafted features from raw data. In this paper, we introduce a system called One Button Machine, or OneBM for short, which automates feature discovery in relational databases. OneBM automatically performs a key activity of data scientists, namely, joining of database tables and applying advanced data transformations to extract useful features from data. We validated OneBM in Kaggle competitions in which OneBM achieved performance as good as top 16% to 24% data scientists in three Kaggle competitions. More importantly, OneBM outperformed the state-of-the-art system in a Kaggle competition in terms of prediction accuracy and ranking on Kaggle leaderboard. The results show that OneBM can be useful for both data scientists and non-experts. It helps data scientists reduce data exploration time allowing them to try and error many ideas in short time. On the other hand, it enables non-experts, who are not familiar with data science, to quickly extract value from their data with a little effort, time and cost.

References in corpus (2)

• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
• Automatic Construction and Natural-Language Description of Nonparametric Regression Models

Cited by in corpus (18)

• Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
• Automated data processing and feature engineering for deep learning and big data applications: a survey
• AutoDS: Towards Human-Centered Automation of Data Science
• AutoAIViz: Opening the Blackbox of Automated Artificial Intelligence with Conditional Parallel Coordinates
• Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"
• How Much Automation Does a Data Scientist Want?
• Feature construction using explanations of individual predictions
• Supervised Learning on Relational Databases with Graph Neural Networks
• Neural Feature Learning From Relational Database
• AutoDOViz: Human-Centered Automation for Decision Optimization
• Engineering Reliable Deep Learning Systems
• DIFER: Differentiable Automated Feature Engineering
• SAFE: Scalable Automatic Feature Engineering Framework for Industrial Tasks
• AEFE: Automatic Embedded Feature Engineering for Categorical Features
• A Lightweight Algorithm to Uncover Deep Relationships in Data Tables
• Fast Automatic Feature Selection for Multi-Period Sliding Window Aggregate in Time Series
• AutoSmart: An Efficient and Automatic Machine Learning framework for Temporal Relational Data
• Augmented Data Science: Towards Industrialization and Democratization of Data Science