Taming the latency in multi-user VR 360: A QoE-aware deep learning-aided multicast framework
arXiv:1811.07388 · doi:10.1109/TCOMM.2020.2965527
Abstract
Immersive virtual reality (VR) applications require ultra-high data rate and low-latency for smooth operation. Hence in this paper, aiming to improve VR experience in multi-user VR wireless video streaming, a deep-learning aided scheme for maximizing the quality of the delivered video chunks with low-latency is proposed. Therein the correlations in the predicted field of view (FoV) and locations of viewers watching 360 HD VR videos are capitalized on to realize a proactive FoV-centric millimeter wave (mmWave) physical-layer multicast transmission. The problem is cast as a frame quality maximization problem subject to tight latency constraints and network stability. The problem is then decoupled into an HD frame request admission and scheduling subproblems and a matching theory game is formulated to solve the scheduling subproblem by associating requests from clusters of users to mmWave small cell base stations (SBSs) for their unicast/multicast transmission. Furthermore, for realistic modeling and simulation purposes, a real VR head-tracking dataset and a deep recurrent neural network (DRNN) based on gated recurrent units (GRUs) are leveraged. Extensive simulation results show how the content-reuse for clusters of users with highly overlapping FoVs brought in by multicasting reduces the VR frame delay in 12\%. This reduction is further boosted by proactiveness that cuts by half the average delays of both reactive unicast and multicast baselines while preserving HD delivery rates above 98\%. Finally, enforcing tight latency bounds shortens the delay-tail as evinced by 13\% lower delays in the 99th percentile.
arXiv commentAccepted for publication in IEEE Transactions on Communications 17 pages, 10 Figures
References in corpus (13)
- Adam: A Method for Stochastic Optimization
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- Towards Low-Latency and Ultra-Reliable Virtual Reality
- Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Model
- Sub-channel Assignment, Power Allocation and User Scheduling for Non-Orthogonal Multiple Access Networks
- Viewport-Adaptive Navigable 360-Degree Video Delivery
- Predicting Head Movement in Panoramic Video: A Deep Reinforcement Learning Approach
- On the Joint Impact of Beamwidth and Orientation Error on Throughput in Directional Wireless Poisson Networks
- Statistical Blockage Modeling and Robustness of Beamforming in Millimeter Wave Systems
- Edge Computing Meets Millimeter-wave Enabled VR: Paving the Way to Cutting the Cord
- Ultra-Reliable Communication in 5G mmWave Networks: A Risk-Sensitive Approach
- A Rate Adaptation Algorithm for Tile-based 360-degree Video Streaming
- Beyond WYSIWYG: Sharing Contextual Sensing Data Through mmWave V2V Communications
Cited by in corpus (12)
- A Tutorial on 5G Positioning
- When Virtual Reality Meets Rate Splitting Multiple Access: A Joint Communication and Computation Approach
- User Dynamics-Aware Edge Caching and Computing for Mobile Virtual Reality
- Millimeter-Wave Beamforming with Continuous Coverage for Mobile Interactive Virtual Reality
- Cross Layer Optimization and Distributed Reinforcement Learning for Wireless 360° Video Streaming
- Correlation-aware Cooperative Multigroup Broadcast 360° Video Delivery Network: A Hierarchical Deep Reinforcement Learning Approach
- Prediction, Communication, and Computing Duration Optimization for VR Video Streaming
- QoE Driven VR 360 Video Massive MIMO Transmission
- Privacy-aware VR streaming
- Adaptive Bitrate Video Streaming for Wireless nodes: A Survey
- Power-Efficient Wireless Streaming of Multi-Quality Tiled 360 VR Video in MIMO-OFDMA Systems
- Duration-Squeezing-Aware Communication and Computing for Proactive VR