Energy-Efficient Transformer Inference: Optimization Strategies for Time Series Classification
arXiv:2502.16627 · doi:10.5120/ijca2025924771
Abstract
The increasing computational demands of transformer models in time series classification necessitate effective optimization strategies for energy-efficient deployment. Our study presents a systematic investigation of optimization techniques, focusing on structured pruning and quantization methods for transformer architectures. Through extensive experimentation on three distinct datasets (RefrigerationDevices, ElectricDevices, and PLAID), we quantitatively evaluate model performance and energy efficiency across different transformer configurations. Our experimental results demonstrate that static quantization reduces energy consumption by 29.14% while maintaining classification performance, and L1 pruning achieves a 63% improvement in inference speed with minimal accuracy degradation. Our findings provide valuable insights into the effectiveness of optimization strategies for transformer-based time series classification, establishing a foundation for efficient model deployment in resource-constrained environments.
References in corpus (5)
- A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multipliers
- Are Transformers Effective for Time Series Forecasting?
- Full Stack Optimization of Transformer Inference: a Survey
- A Survey of Techniques for Optimizing Transformer Inference
- Optimal Inferential Control of Convolutional Neural Networks