Rafiki: Machine Learning as an Analytics Service System

Abstract

Big data analytics is gaining massive momentum in the last few years. Applying machine learning models to big data has become an implicit requirement or an expectation for most analysis tasks, especially on high-stakes applications.Typical applications include sentiment analysis against reviews for analyzing on-line products, image classification in food logging applications for monitoring user's daily intake and stock movement prediction. Extending traditional database systems to support the above analysis is intriguing but challenging. First, it is almost impossible to implement all machine learning models in the database engines. Second, expertise knowledge is required to optimize the training and inference procedures in terms of efficiency and effectiveness, which imposes heavy burden on the system users. In this paper, we develop and present a system, called Rafiki, to provide the training and inference service of machine learning models, and facilitate complex analytics on top of cloud platforms. Rafiki provides distributed hyper-parameter tuning for the training service, and online ensemble modeling for the inference service which trades off between latency and accuracy. Experimental results confirm the efficiency, effectiveness, scalability and usability of Rafiki.

arXiv comment13 pages

References in corpus (10)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
• Deep Residual Learning for Image Recognition
• Neural Architecture Search with Reinforcement Learning
• Improved Regularization of Convolutional Neural Networks with Cutout
• Going Deeper with Convolutions
• Deep Reinforcement Learning: An Overview
• Database Meets Deep Learning: Challenges and Opportunities
• Ease.ml: Towards Multi-tenant Resource Sharing for Machine Learning Workloads

Cited by in corpus (4)

• Fast Parallel Hypertree Decompositions in Logarithmic Recursion Depth
• Automated Machine Learning: State-of-The-Art and Open Challenges
• Parity Models: A General Framework for Coding-Based Resilience in ML Inference
• IPA: Inference Pipeline Adaptation to Achieve High Accuracy and Cost-Efficiency