Machine Learning Systems: A Survey from a Data-Oriented Perspective
arXiv:2302.04810 · doi:10.1145/3769292
Abstract
Engineers are deploying ML models as parts of real-world systems with the upsurge of AI technologies. Real-world environments challenge the deployment of such systems because these environments produce large amounts of heterogeneous data, and users require increasingly efficient responses. These requirements push prevalent software architectures to the limit when deploying ML-based systems. Data-oriented Architecture (DOA) is an emerging style that equips systems better for integrating ML models. Even though papers on deployed ML systems do not mention DOA, their authors made design decisions that implicitly follow DOA. Implicit decisions create a knowledge gap, limiting the practitioners' ability to implement ML-based systems. \hlb{This paper surveys why, how, and to what extent practitioners have adopted DOA to implement and deploy ML-based systems.} We overcome the knowledge gap by answering these questions and explicitly showing the design decisions and practices behind these systems. The survey follows a well-known systematic and semi-automated methodology for reviewing papers in software engineering. The majority of reviewed works partially adopt DOA. Such an adoption enables systems to address requirements such as Big Data management, low latency processing, resource management, security and privacy. Based on these findings, we formulate practical advice to facilitate the deployment of ML-based systems.
Under review CSUR
References in corpus (9)
- Data-Driven Grasp Synthesis - A Survey
- SmartSantander: IoT Experimentation over a Smart City Testbed
- Challenges in Deploying Machine Learning: a Survey of Case Studies
- The STRANDS Project: Long-Term Autonomy in Everyday Environments
- Decision Provenance: Harnessing data flow for accountable systems
- Making Contextual Decisions with Low Technical Debt
- The Breakthrough Listen Search for Intelligent Life: Public Data, Formats, Reduction and Archiving
- iTeleScope: Intelligent Video Telemetry and Classification in Real-Time using Software Defined Networking
- Enabling All In-Edge Deep Learning: A Literature Review