XR-RF Imaging Enabled by Software-Defined Metasurfaces and Machine Learning: Foundational Vision, Technologies and Challenges
arXiv:2209.15436 · doi:10.1109/ACCESS.2022.3219871
Abstract
We present a new approach to Extended Reality (XR), denoted as iCOPYWAVES, which seeks to offer naturally low-latency operation and cost-effectiveness, overcoming the critical scalability issues faced by existing solutions. iCOPYWAVES is enabled by emerging PWEs, a recently proposed technology in wireless communications. Empowered by intelligent (meta)surfaces, PWEs transform the wave propagation phenomenon into a software-defined process. We leverage PWEs to i) create, and then ii) selectively copy the scattered RF wavefront of an object from one location in space to another, where a machine learning module, accelerated by FPGAs, translates it to visual input for an XR headset using PWEdriven, RF imaging principles (XR-RF). This makes for an XR system whose operation is bounded in the physical layer and, hence, has the prospects for minimal end-to-end latency. Over large distances, RF-to-fiber/fiber-to-RF is employed to provide intermediate connectivity. The paper provides a tutorial on the iCOPYWAVES system architecture and workflow. A proof-of-concept implementation via simulations is provided, demonstrating the reconstruction of challenging objects in iCOPYWAVES produced computer graphics.
References in corpus (19)
- Wireless Communications with Reconfigurable Intelligent Surface: Path Loss Modeling and Experimental Measurement
- Towards Dual-functional Radar-Communication Systems: Optimal Waveform Design
- Intelligent Reflecting Surface-Enhanced OFDM: Channel Estimation and Reflection Optimization
- Ultra-Low Latency (ULL) Networks: The IEEE TSN and IETF DetNet Standards and Related 5G ULL Research
- Liquid Crystal Tunable Metamaterial Perfect Absorber
- Towards Low-Latency and Ultra-Reliable Virtual Reality
- MIMO Transmission through Reconfigurable Intelligent Surface: System Design, Analysis, and Implementation
- Metasurface-Assisted Passive Wireless Communication with Commodity Wi-Fi Signals
- Intelligent Metasurfaces with Continuously Tunable Local Surface Impedance for Multiple Reconfigurable Functions
- Artificial Neural Network with Physical Dynamic Metasurface Layer for Optimal Sensing
- Optimal Communication Channels in a Disordered World with Tamed Randomness
- A multi-functional reconfigurable metasurface: Electromagnetic design accounting for fabrication aspects
- A Novel Communication Paradigm for High Capacity and Security via Programmable Indoor Wireless Environments in Next Generation Wireless Systems
- PhysFad: Physics-Based End-to-End Channel Modeling of RIS-Parametrized Environments with Adjustable Fading
- Reprogrammable Graphene-based Metasurface Mirror with Adaptive Focal Point for THz Imaging
- Intelligent Meta-Imagers: From Compressed to Learned Sensing
- Deeply Sub-Wavelength Localization with Reverberation-Coded-Aperture
- Modeling, Simulating and Configuring Programmable Wireless Environments for Multi-User Multi-Objective Networking
- Multi-functional metasurface architecture for amplitude, polarization and wavefront control