Learning Based Frequency- and Time-Domain Inter-Cell Interference Coordination in HetNets

Abstract

In this article, we focus on inter-cell interference coordination (ICIC) techniques in heterogeneous network (Het-Net) deployments, whereby macro- and picocells autonomously optimize their downlink transmissions, with loose coordination. We model this strategic coexistence as a multi-agent system, aiming at joint interference management and cell association. Using tools from Reinforcement Learning (RL), agents (i.e., macro- and picocells) sense their environment, and self-adapt based on local information so as to maximize their network performance. Specifically, we explore both time- and frequency domain ICIC scenarios, and propose a two-level RL formulation. Here, picocells learn their optimal cell range expansion (CRE) bias and transmit power allocation, as well as appropriate frequency bands for multi-flow transmissions, in which a user equipment (UE) can be simultaneously served by two or more base stations (BSs) from macro- and pico-layers. To substantiate our theoretical findings, Long Term Evolution Advanced (LTEA) based system level simulations are carried out in which our proposed approaches are compared with a number of baseline approaches, such as resource partitioning (RP), static CRE, and single-flow Carrier Aggregation (CA). Our proposed solutions yield substantial gains up to 125% compared to static ICIC approaches in terms of average UE throughput in the timedomain. In the frequency-domain our proposed solutions yield gains up to 240% in terms of cell-edge UE throughput.

References in corpus (5)

• Modeling and Analysis of K-Tier Downlink Heterogeneous Cellular Networks
• Enhanced Inter-Cell Interference Coordination Challenges in Heterogeneous Networks
• Heterogeneous Cellular Networks with Flexible Cell Association: A Comprehensive Downlink SINR Analysis
• Offloading in Heterogeneous Networks: Modeling, Analysis, and Design Insights
• Modeling, Analysis and Design for Carrier Aggregation in Heterogeneous Cellular Networks

Cited by in corpus (6)

• AI based Service Management for 6G Green Communications
• Learning-Based Multi-Channel Access in 5G and Beyond Networks with Fast Time-Varying Channels
• Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches
• Deep Reinforcement Learning Based Mode Selection and Resource Management for Green Fog Radio Access Networks
• Multi-Cell Interference Exploitation: A New Dimension in Cell Coordination
• Reinforcement Learning Assisted Beamforming for Inter-cell Interference Mitigation in 5G Massive MIMO Networks