Harnessing Multimodal Sensing for Multi-user Beamforming in mmWave Systems
arXiv:2406.05300 · doi:10.1109/TWC.2024.3475950
Abstract
Sensor-aided beamforming reduces the overheads associated with beam training in millimeter-wave (mmWave) multi-input-multi-output (MIMO) communication systems. Most prior work, though, neglects the challenges associated with establishing multi-user (MU) communication links in mmWave MIMO systems. In this paper, we propose a new framework for sensor-aided beam training in MU mmWave MIMO system. We leverage the beamspace representation of the channel that contains only the angles-of-departure (AoDs) of the channel's significant multipath components. We show that a deep neural network (DNN)-based multimodal sensor fusion framework can estimate the beamspace representation of the channel using sensor data. To aid the DNN training, we introduce a novel supervised soft-contrastive loss (SSCL) function that leverages the inherent similarity between channels to extract similar features from the sensor data for similar channels. Finally, we design an MU beamforming strategy that uses the estimated beamspaces of the channels to select analog precoders for all users in a way that prevents transmission to multiple users over the same directions. Compared to the baseline, our approach achieves more than 4 improvement in the median sum-spectral efficiency (SE) at 42 dBm equivalent isotropic radiated power (EIRP) with 4 active users. This demonstrates that sensor data can provide more channel information than previously explored, with significant implications for machine learning (ML)-based communication and sensing systems.
References in corpus (8)
- An Overview of Signal Processing Techniques for Millimeter Wave MIMO Systems
- Limited Feedback Hybrid Precoding for Multi-User Millimeter Wave Systems
- A Tutorial on Beam Management for 3GPP NR at mmWave Frequencies
- LIDAR Data for Deep Learning-Based mmWave Beam-Selection
- Channel Estimation and Hybrid Precoding for Frequency Selective Multiuser mmWave MIMO Systems
- The Impact of Mobile Blockers on Millimeter Wave Cellular Systems
- Channel Estimation for mmWave Massive MIMO Based Access and Backhaul in Ultra-Dense Network
- Machine Learning on Camera Images for Fast mmWave Beamforming