Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming

Abstract

Extended reality (XR) is rapidly advancing, and poised to revolutionize content creation and consumption. In XR, users integrate various sensory inputs to form a cohesive perception of the virtual environment. This survey reviews the state-of-the-art in XR streaming, focusing on multiple paradigms. To begin, we define XR and introduce various XR headsets along with their multimodal interaction methods to provide a foundational understanding. We then analyze XR traffic characteristics to highlight the unique data transmission requirements. We also explore factors that influence the quality of experience in XR systems, aiming to identify key elements for enhancing user satisfaction. Following this, we present visual attention-based optimization methods for XR streaming to improve efficiency and performance. Finally, we examine current applications and highlight challenges to provide insights into ongoing and future developments of XR.

accepted by ACM Transactions on Multimedia Computing, Communications, and Applications

References in corpus (9)

• Technical Evaluation of HoloLens for Multimedia: A First Look
• Confusing Image Quality Assessment: Towards Better Augmented Reality Experience
• The Metaverse from a Multimedia Communications Perspective
• Human-Centric Resource Allocation for the Metaverse With Multiaccess Edge Computing
• MADRL-Based Rate Adaptation for 360° Video Streaming with Multi-Viewpoint Prediction
• Towards a QoE Model to Evaluate Holographic Augmented Reality Devices
• Interacting with New York City Data by HoloLens through Remote Rendering
• Multi-Path Cooperative Communications Networks for Augmented and Virtual Reality Transmission
• Sequential Reinforced 360-Degree Video Adaptive Streaming with Cross-user Attentive Network