Multi-objective application placement in fog computing using graph neural network-based reinforcement learning

Abstract

We propose a framework designed to tackle a multi-objective optimization challenge related to the placement of applications in fog computing, employing a deep reinforcement learning (DRL) approach. Unlike other optimization techniques, such as integer linear programming or genetic algorithms, DRL models are applied in real time to solve similar problem situations after training. Our model comprises a learning process featuring a graph neural network and two actor-critics, providing a holistic perspective on the priorities concerning interconnected services that constitute an application. The learning model incorporates the relationships between services as a crucial factor in placement decisions: Services with higher dependencies take precedence in location selection. Our experimental investigation involves illustrative cases where we compare our results with baseline strategies and genetic algorithms. We observed a comparable Pareto set with negligible execution times, measured in the order of milliseconds, in contrast to the hours required by alternative approaches.

References in corpus (7)

• pymoo: Multi-objective Optimization in Python
• Deep Reinforcement Learning for Multi-objective Optimization
• Fast Adaptive Task Offloading in Edge Computing based on Meta Reinforcement Learning
• AI-based Fog and Edge Computing: A Systematic Review, Taxonomy and Future Directions
• Deep Reinforcement Learning-based Methods for Resource Scheduling in Cloud Computing: A Review and Future Directions
• How to Place Your Apps in the Fog -- State of the Art and Open Challenges
• Availability-aware Service Placement Policy in Fog Computing Based on Graph Partitions