Cloudy with high chance of DBMS: A 10-year prediction for Enterprise-Grade ML
arXiv:1909.00084
Abstract
Machine learning (ML) has proven itself in high-value web applications such as search ranking and is emerging as a powerful tool in a much broader range of enterprise scenarios including voice recognition and conversational understanding for customer support, autotuning for videoconferencing, intelligent feedback loops in large-scale sysops, manufacturing and autonomous vehicle management, complex financial predictions, just to name a few. Meanwhile, as the value of data is increasingly recognized and monetized, concerns about securing valuable data and risks to individual privacy have been growing. Consequently, rigorous data management has emerged as a key requirement in enterprise settings. How will these trends (ML growing popularity, and stricter data governance) intersect? What are the unmet requirements for applying ML in enterprise settings? What are the technical challenges for the DB community to solve? In this paper, we present our vision of how ML and database systems are likely to come together, and early steps we take towards making this vision a reality.
References in corpus (9)
- The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks
- Horovod: fast and easy distributed deep learning in TensorFlow
- TVM: An Automated End-to-End Optimizing Compiler for Deep Learning
- TensorFlow-Serving: Flexible, High-Performance ML Serving
- LaraDB: A Minimalist Kernel for Linear and Relational Algebra Computation
- The MADlib Analytics Library or MAD Skills, the SQL
- Extending Relational Query Processing with ML Inference
- Data Science through the looking glass and what we found there
- Query and Resource Optimizations: A Case for Breaking the Wall in Big Data Systems