Cold Start Latency in Serverless Computing: A Systematic Review, Taxonomy, and Future Directions
arXiv:2310.08437 · doi:10.1145/3700875
Abstract
Recently, academics and the corporate sector have paid attention to serverless computing, which enables dynamic scalability and an economic model. In serverless computing, users only pay for the time they actually use resources, enabling zero scaling to optimise cost and resource utilisation. However, this approach also introduces the serverless cold start problem. Researchers have developed various solutions to address the cold start problem, yet it remains an unresolved research area. In this article, we propose a systematic literature review on clod start latency in serverless computing. Furthermore, we create a detailed taxonomy of approaches to cold start latency, which we use to investigate existing techniques for reducing the cold start time and frequency. We have classified the current studies on cold start latency into several categories such as caching and application-level optimisation-based solutions, as well as Artificial Intelligence (AI)/Machine Learning (ML)-based solutions. Moreover, we have analyzed the impact of cold start latency on quality of service, explored current cold start latency mitigation methods, datasets, and implementation platforms, and classified them into categories based on their common characteristics and features. Finally, we outline the open challenges and highlight the possible future directions.
Preprint Version Accepted for Publication in ACM Computing Survey, 2024
References in corpus (11)
- AI for Next Generation Computing: Emerging Trends and Future Directions
- AI-based Fog and Edge Computing: A Systematic Review, Taxonomy and Future Directions
- Edge AI: A Taxonomy, Systematic Review and Future Directions
- The Serverless Computing Survey: A Technical Primer for Design Architecture
- Benchmarking, Analysis, and Optimization of Serverless Function Snapshots
- Serverless Applications: Why, When, and How?
- A Review of Serverless Use Cases and their Characteristics
- EdgeAISim: A Toolkit for Simulation and Modelling of AI Models in Edge Computing Environments
- Equilibrium in the Computing Continuum through Active Inference
- Computing: Looking Back and Moving Forward
- Achieving High Throughput and Elasticity in a Larger-than-Memory Store
Cited by in corpus (5)
- Edge AI: A Taxonomy, Systematic Review and Future Directions
- QFaaS: A Serverless Function-as-a-Service Framework for Quantum Computing
- LLM-Driven APT Detection for 6G Wireless Networks: A Systematic Review and Taxonomy
- Computing: Looking Back and Moving Forward
- Optimizing Cloud Deployment: Blending of IaaS and FaaS for Microservice Architecture