LACS: Learning-Augmented Algorithms for Carbon-Aware Resource Scaling with Uncertain Demand
arXiv:2404.15211 · doi:10.1145/3632775.3661942
Abstract
Motivated by an imperative to reduce the carbon emissions of cloud data centers, this paper studies the online carbon-aware resource scaling problem with unknown job lengths (OCSU) and applies it to carbon-aware resource scaling for executing computing workloads. The task is to dynamically scale resources (e.g., the number of servers) assigned to a job of unknown length such that it is completed before a deadline, with the objective of reducing the carbon emissions of executing the workload. The total carbon emissions of executing a job originate from the emissions of running the job and excess carbon emitted while switching between different scales (e.g., due to checkpoint and resume). Prior work on carbon-aware resource scaling has assumed accurate job length information, while other approaches have ignored switching losses and require carbon intensity forecasts. These assumptions prohibit the practical deployment of prior work for online carbon-aware execution of scalable computing workload. We propose LACS, a theoretically robust learning-augmented algorithm that solves OCSU. To achieve improved practical average-case performance, LACS integrates machine-learned predictions of job length. To achieve solid theoretical performance, LACS extends the recent theoretical advances on online conversion with switching costs to handle a scenario where the job length is unknown. Our experimental evaluations demonstrate that, on average, the carbon footprint of LACS lies within 1.2% of the online baseline that assumes perfect job length information and within 16% of the offline baseline that, in addition to the job length, also requires accurate carbon intensity forecasts. Furthermore, LACS achieves a 32% reduction in carbon footprint compared to the deadline-aware carbon-agnostic execution of the job.
References in corpus (10)
- SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
- Power Hungry Processing: Watts Driving the Cost of AI Deployment?
- Let's Wait Awhile: How Temporal Workload Shifting Can Reduce Carbon Emissions in the Cloud
- CarbonScaler: Leveraging Cloud Workload Elasticity for Optimizing Carbon-Efficiency
- On the Limitations of Carbon-Aware Temporal and Spatial Workload Shifting in the Cloud
- The Dirty Secret of SSDs: Embodied Carbon
- CASPER: Carbon-Aware Scheduling and Provisioning for Distributed Web Services
- The Online Pause and Resume Problem: Optimal Algorithms and An Application to Carbon-Aware Load Shifting
- The War of the Efficiencies: Understanding the Tension between Carbon and Energy Optimization
- Carbon Containers: A System-level Facility for Managing Application-level Carbon Emissions