296 citations · 903 across the 27 of their papers we have counts for
28 papers
Generative-AI for XR Content Transmission in the Metaverse: Potential Approaches, Challenges, and a Generation-Driven Transmission Framework
Zhe Zhang, Yili Jiang, Xin Wei +3
How to efficiently transmit large volumes of Extended Reality (XR) content through current networks has been a major bottleneck in realizing the Metaverse. The recently emerging Ge…
The Potential of Haptic Foundation Models
Jianquan Wang, Haiwei Dong, Abdulmotaleb El Saddik
Despite the success of foundation models in language and vision, their expansion into embodied AI is bottlenecked by a lack of generalized touch sensing. This limitation is especia…
3D Wi-Fi Signal Measurement in Realistic Digital Twin Testbed Environments Using Ray Tracing
Mengyuan Wang, Haopeng Wang, Haiwei Dong +1
Accurate and efficient modeling of indoor wireless signal propagation is crucial for the deployment of next-generation Wi-Fi. This paper presents a digital twin-based measurement s…
Adaptive Social Metaverse Streaming based on Federated Multi-Agent Deep Reinforcement Learning
Zijian Long, Haopeng Wang, Haiwei Dong +1
The social metaverse is a growing digital ecosystem that blends virtual and physical worlds. It allows users to interact socially, work, shop, and enjoy entertainment. However, pri…
Empirical Studies of Large Scale Environment Scanning by Consumer Electronics
Mengyuan Wang, Yang Liu, Haopeng Wang +2
This paper presents an empirical evaluation of the Matterport Pro3, a consumer-grade 3D scanning device, for large-scale environment reconstruction. We conduct detailed scanning (1…
Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming
Haopeng Wang, Haiwei Dong, Abdulmotaleb El Saddik
Extended reality (XR) is rapidly advancing, and poised to revolutionize content creation and consumption. In XR, users integrate various sensory inputs to form a cohesive perceptio…
MetaDecorator: Generating Immersive Virtual Tours through Multimodality
Shuang Xie, Yang Liu, Jeannie S. A. Lee +1
MetaDecorator, is a framework that empowers users to personalize virtual spaces. By leveraging text-driven prompts and image synthesis techniques, MetaDecorator adorns static panor…
Leveraging LLMs to Create a Haptic Devices' Recommendation System
Yang Liu, Haiwei Dong, Abdulmotaleb El Saddik
Haptic technology has seen significant growth, yet a lack of awareness of existing haptic device design knowledge hinders development. This paper addresses these limitations by lev…
MADRL-Based Rate Adaptation for 360° Video Streaming with Multi-Viewpoint Prediction
Haopeng Wang, Zijian Long, Haiwei Dong +1
Over the last few years, 360° video traffic on the network has grown significantly. A key challenge of 360° video playback is ensuring a high quality of experience (QoE) with limit…
Tile-Weighted Rate-Distortion Optimized Packet Scheduling for 360 VR Video Streaming
Haopeng Wang, Haiwei Dong, Abdulmotaleb El Saddik
A key challenge of 360 VR video streaming is ensuring high quality with limited network bandwidth. Currently, most studies focus on tile-based adaptive bitrate streaming to…
How to Cache Important Contents for Multi-modal Service in Dynamic Networks: A DRL-based Caching Scheme
Zhe Zhang, Marc St-Hilaire, Xin Wei +2
With the continuous evolution of networking technologies, multi-modal services that involve video, audio, and haptic contents are expected to become the dominant multimedia service…
Experimental Studies of Metaverse Streaming
Haopeng Wang, Roberto Martinez-Velazquez, Haiwei Dong +1
Metaverse aims to construct a large, unified, immersive, and shared digital realm by combining various technologies, namely XR (extended reality), blockchain, and digital twin, amo…
Bringing Robots Home: The Rise of AI Robots in Consumer Electronics
Haiwei Dong, Yang Liu, Ted Chu +1
On March 18, 2024, NVIDIA unveiled Project GR00T, a general-purpose multimodal generative AI model designed specifically for training humanoid robots. Preceding this event, Tesla's…
Human-Centric Resource Allocation for the Metaverse With Multiaccess Edge Computing
Zijian Long, Haiwei Dong, Abdulmotaleb El Saddik
Multi-access edge computing (MEC) is a promising solution to the computation-intensive, low-latency rendering tasks of the metaverse. However, how to optimally allocate limited com…
A Deep Reinforcement Learning Framework for Optimizing Congestion Control in Data Centers
Shiva Ketabi, Hongkai Chen, Haiwei Dong +1
Various congestion control protocols have been designed to achieve high performance in different network environments. Modern online learning solutions that delegate the congestion…
The Metaverse from a Multimedia Communications Perspective
Haiwei Dong, Jeannie S. A. Lee
eXtended reality (XR) technologies such as virtual reality and 360° stereoscopic streaming enable the concept of the Metaverse, an immersive virtual space for collaboration and int…
Development of an automatic 3D human head scanning-printing system
Longyu Zhang, Bote Han, Haiwei Dong +1
Three-dimensional (3D) technologies have been developing rapidly recent years, and have influenced industrial, medical, cultural, and many other fields. In this paper, we introduce…
A Framework of Reconfigurable Transducer Nodes for Smart Home Environments
Basim Hafidh, Hussein Al Osman, Haiwei Dong +1
This letter presents a transducer network framework that supports the amalgamation of multiple transducers into single wireless nodes. This approach is aimed at decreasing energy c…
3-D Markerless Tracking of Human Gait by Geometric Trilateration of Multiple Kinects
Lin Yang, Bowen Yang, Haiwei Dong +1
In this paper, we develop an integrated markerless gait tracking system with three Kinect v2 sensors. A geometric principle-based trilateration method is proposed for optimizing th…
A Combined Approach Toward Consistent Reconstructions of Indoor Spaces Based on 6D RGB-D Odometry and KinectFusion
Nadia Figueroa, Haiwei Dong, Abdulmotaleb El Saddik
We propose a 6D RGB-D odometry approach that finds the relative camera pose between consecutive RGB-D frames by keypoint extraction and feature matching both on the RGB and depth i…
Development of a Self-Calibrated Motion Capture System by Nonlinear Trilateration of Multiple Kinects v2
Bowen Yang, Haiwei Dong, Abdulmotaleb El Saddik
In this paper, a Kinect-based distributed and real-time motion capture system is developed. A trigonometric method is applied to calculate the relative position of Kinect v2 sensor…
Evaluating and Improving the Depth Accuracy of Kinect for Windows v2
Lin Yang, Longyu Zhang, Haiwei Dong +2
Microsoft Kinect sensor has been widely used in many applications since the launch of its first version. Recently, Microsoft released a new version of Kinect sensor with improved h…
EVM-CNN: Real-Time Contactless Heart Rate Estimation from Facial Video
Ying Qiu, Yang Liu, Juan Arteaga-Falconi +2
With the increase in health consciousness, noninvasive body monitoring has aroused interest among researchers. As one of the most important pieces of physiological information, res…
Towards a QoE Model to Evaluate Holographic Augmented Reality Devices
Longyu Zhang, Haiwei Dong, Abdulmotaleb El Saddik
Augmented reality (AR) technology is developing fast and provides users with new ways to interact with the real-world surrounding environment. Although the performance of holograph…