Towards Ubiquitous Semantic Metaverse: Challenges, Approaches, and Opportunities

Abstract

In recent years, ubiquitous semantic Metaverse has been studied to revolutionize immersive cyber-virtual experiences for augmented reality (AR) and virtual reality (VR) users, which leverages advanced semantic understanding and representation to enable seamless, context-aware interactions within mixed-reality environments. This survey focuses on the intelligence and spatio-temporal characteristics of four fundamental system components in ubiquitous semantic Metaverse, i.e., artificial intelligence (AI), spatio-temporal data representation (STDR), semantic Internet of Things (SIoT), and semantic-enhanced digital twin (SDT). We thoroughly survey the representative techniques of the four fundamental system components that enable intelligent, personalized, and context-aware interactions with typical use cases of the ubiquitous semantic Metaverse, such as remote education, work and collaboration, entertainment and socialization, healthcare, and e-commerce marketing. Furthermore, we outline the opportunities for constructing the future ubiquitous semantic Metaverse, including scalability and interoperability, privacy and security, performance measurement and standardization, as well as ethical considerations and responsible AI. Addressing those challenges is important for creating a robust, secure, and ethically sound system environment that offers engaging immersive experiences for the users and AR/VR applications.

18 pages, 7 figures, 3 tables. Accepted to IEEE Internet of Things Journal (to appear)

References in corpus (16)

• A Survey on Metaverse: Fundamentals, Security, and Privacy
• Edge Learning for B5G Networks with Distributed Signal Processing: Semantic Communication, Edge Computing, and Wireless Sensing
• Blockchain for the Internet of Vehicles towards Intelligent Transportation Systems: A Survey
• RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representation
• A Survey of Data Fusion in Smart City Applications
• Semantic Communications: Principles and Challenges
• Will Metaverse be NextG Internet? Vision, Hype, and Reality
• Metaverse: Survey, Applications, Security, and Opportunities
• Engineering Semantic Communication: A Survey
• A Survey on Semantic Communications for Intelligent Wireless Networks
• Design and Implementation of Secret Key Agreement for Platoon-based Vehicular Cyber-Physical Systems
• Stochastic Resource Allocation for Semantic Communication-aided Virtual Transportation Networks in the Metaverse
• Semantic Sensing and Communications for Ultimate Extended Reality
• Semantics-Empowered Communication: A Tutorial-cum-Survey
• Edge Computing for Semantic Communication Enabled Metaverse: An Incentive Mechanism Design
• Semantic Communications in Multi-user Wireless Networks

Cited by in corpus (4)

• Overview of AI and Communication for 6G Network: Fundamentals, Challenges, and Future Research Opportunities
• Forging the Industrial Metaverse -- Where Industry 5.0, Augmented and Mixed Reality, IIoT, Opportunistic Edge Computing and Digital Twins Meet
• Recent Advances in Deep Learning for Channel Coding: A Survey
• A Blockchain-based Reliable Federated Meta-learning for Metaverse: A Dual Game Framework