Reducing Idleness in Financial Cloud Services via Multi-objective Evolutionary Reinforcement Learning based Load Balancer
arXiv:2305.03463 · doi:10.1007/s11432-023-3895-3
Abstract
In recent years, various companies have started to shift their data services from traditional data centers to the cloud. One of the major motivations is to save on operational costs with the aid of cloud elasticity. This paper discusses an emerging need from financial services to reduce the incidence of idle servers retaining very few user connections, without disconnecting them from the server side. This paper considers this need as a bi-objective online load balancing problem. A neural network based scalable policy is designed to route user requests to varied numbers of servers for the required elasticity. An evolutionary multi-objective training framework is proposed to optimize the weights of the policy. Not only is the new objective of idleness is reduced by over 130% more than traditional industrial solutions, but the original load balancing objective itself is also slightly improved. Extensive simulations with both synthetic and real-world data help reveal the detailed applicability of the proposed method to the emergent problem of reducing idleness in financial services.
20 pages, 14 figures
References in corpus (6)
- Evolutionary Reinforcement Learning: A Survey
- Derivative-Free Reinforcement Learning: A Review
- ERL-Re: Efficient Evolutionary Reinforcement Learning with Shared State Representation and Individual Policy Representation
- Effective and Imperceptible Adversarial Textual Attack via Multi-objectivization
- How Good Is Neural Combinatorial Optimization? A Systematic Evaluation on the Traveling Salesman Problem
- Enhancing SAEAs with Unevaluated Solutions: A Case Study of Relation Model for Expensive Optimization