Mulsemedia Communication Research Challenges for Metaverse in 6G Wireless Systems

Abstract

Although humans have five basic senses, sight, hearing, touch, smell, and taste, most multimedia systems in current systems only capture two of them, namely, sight and hearing. With the development of the metaverse and related technologies, there is a growing need for a more immersive media format that leverages all human senses. Multisensory media(Mulsemedia) that can stimulate multiple senses will play a critical role in the near future. This paper provides an overview of the history, background, use cases, existing research, devices, and standards of mulsemedia. Emerging mulsemedia technologies such as Extended Reality (XR) and Holographic-Type Communication (HTC) are introduced. Additionally, the challenges in mulsemedia research from the perspective of wireless communication and networking are discussed. The potential of 6G wireless systems to address these challenges is highlighted, and several research directions that can advance mulsemedia communications are identified.

References in corpus (9)

• All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agenda
• A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems
• Chip-Chat: Challenges and Opportunities in Conversational Hardware Design
• Life, the Metaverse and Everything: An Overview of Privacy, Ethics, and Governance in Metaverse
• TeraHertz Band Communication: An Old Problem Revisited and Research Directions for the Next Decade
• A Comprehensive Study and Comparison of Core Technologies for MPEG 3D Point Cloud Compression
• Learning-based Prediction, Rendering and Transmission for Interactive Virtual Reality in RIS-Assisted Terahertz Networks
• Learning Based Joint Coding-Modulation for Digital Semantic Communication Systems
• Joint Compute-Caching-Communication Control for Online Data-Intensive Service Delivery