Multiscale Representation Enhanced Temporal Flow Fusion Model for Long-Term Workload Forecasting

Abstract

Accurate workload forecasting is critical for efficient resource management in cloud computing systems, enabling effective scheduling and autoscaling. Despite recent advances with transformer-based forecasting models, challenges remain due to the non-stationary, nonlinear characteristics of workload time series and the long-term dependencies. In particular, inconsistent performance between long-term history and near-term forecasts hinders long-range predictions. This paper proposes a novel framework leveraging self-supervised multiscale representation learning to capture both long-term and near-term workload patterns. The long-term history is encoded through multiscale representations while the near-term observations are modeled via temporal flow fusion. These representations of different scales are fused using an attention mechanism and characterized with normalizing flows to handle non-Gaussian/non-linear distributions of time series. Extensive experiments on 9 benchmarks demonstrate superiority over existing methods.

Proceedings of the 33rd ACM International Conference on Information and Knowledge Management (CIKM '24), October 21--25, 2024, Boise, ID, USA

References in corpus (10)

• Normalizing Flows: An Introduction and Review of Current Methods
• Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
• Non-stationary Transformers: Exploring the Stationarity in Time Series Forecasting
• Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistency
• Time Series Change Point Detection with Self-Supervised Contrastive Predictive Coding
• Monotonic Neural Ordinary Differential Equation: Time-series Forecasting for Cumulative Data
• End-to-End Modeling Hierarchical Time Series Using Autoregressive Transformer and Conditional Normalizing Flow based Reconciliation
• Atrapos: Real-time Evaluation of Metapath Query Workloads
• Hierarchical Capsule Prediction Network for Marketing Campaigns Effect
• Prompt-augmented Temporal Point Process for Streaming Event Sequence