Deep Learning Enabled Semantic Communication Systems

Abstract

Recently, deep learned enabled end-to-end (E2E) communication systems have been developed to merge all physical layer blocks in the traditional communication systems, which make joint transceiver optimization possible. Powered by deep learning, natural language processing (NLP) has achieved great success in analyzing and understanding large amounts of language texts. Inspired by research results in both areas, we aim to providing a new view on communication systems from the semantic level. Particularly, we propose a deep learning based semantic communication system, named DeepSC, for text transmission. Based on the Transformer, the DeepSC aims at maximizing the system capacity and minimizing the semantic errors by recovering the meaning of sentences, rather than bit- or symbol-errors in traditional communications. Moreover, transfer learning is used to ensure the DeepSC applicable to different communication environments and to accelerate the model training process. To justify the performance of semantic communications accurately, we also initialize a new metric, named sentence similarity. Compared with the traditional communication system without considering semantic information exchange, the proposed DeepSC is more robust to channel variation and is able to achieve better performance, especially in the low signal-to-noise (SNR) regime, as demonstrated by the extensive simulation results.

arXiv comment13 pages, Journal, accepted by IEEE TSP

References in corpus (9)

• Efficient Estimation of Word Representations in Vector Space
• Neural Machine Translation by Jointly Learning to Align and Translate
• Deep Joint Source-Channel Coding for Wireless Image Transmission
• Learning to Optimize: Training Deep Neural Networks for Wireless Resource Management
• Deep Learning-Based Communication Over the Air
• A Convolutional Neural Network for Modelling Sentences
• Model-Driven Deep Learning for MIMO Detection
• Neural Network Detection of Data Sequences in Communication Systems
• End-to-End Fast Training of Communication Links Without a Channel Model via Online Meta-Learning

Cited by in corpus (89)

• Resource allocation for text semantic communications
• A Survey of Beam Management for mmWave and THz Communications Towards 6G
• Networking Architecture and Key Supporting Technologies for Human Digital Twin in Personalized Healthcare: A Comprehensive Survey
• Deep Source-Channel Coding for Sentence Semantic Transmission with HARQ
• Overview of AI and Communication for 6G Network: Fundamentals, Challenges, and Future Research Opportunities
• Heterogeneous Semantic and Bit Communications: A Semi-NOMA Scheme
• Rethinking Modern Communication from Semantic Coding to Semantic Communication
• Vector Quantized Semantic Communication System
• Exploiting Semantic Communication for Non-Orthogonal Multiple Access
• Engineering Semantic Communication: A Survey
• Towards Goal-Oriented Semantic Signal Processing: Applications and Future Challenges
• A Survey on Semantic Communications for Intelligent Wireless Networks
• Non-Orthogonal Multiple Access Enhanced Multi-User Semantic Communication
• One-to-Many Semantic Communication Systems: Design, Implementation, Performance Evaluation
• Deep Learning-Empowered Semantic Communication Systems with a Shared Knowledge Base
• Understand-Before-Talk (UBT): A Semantic Communication Approach to 6G Networks
• Wireless Resource Management in Intelligent Semantic Communication Networks
• A Joint Communication and Computation Design for Distributed RISs Assisted Probabilistic Semantic Communication in IIoT
• Probabilistic Semantic Communication over Wireless Networks with Rate Splitting
• On the Role of ViT and CNN in Semantic Communications: Analysis and Prototype Validation
• A new communication paradigm: from bit accuracy to semantic fidelity
• Adversarial Attacks and Defenses for Semantic Communication in Vehicular Metaverses
• Reinforcement Learning-powered Semantic Communication via Semantic Similarity
• Joint User Association and Bandwidth Allocation in Semantic Communication Networks
• Swin Transformer-Based Dynamic Semantic Communication for Multi-User with Different Computing Capacity
• Deep Learning in Physical Layer: Review on Data Driven End-to-End Communication Systems and their Enabling Semantic Applications
• Semantics-Native Communication with Contextual Reasoning
• An Efficient Federated Learning Framework for Training Semantic Communication System
• A Joint Communication and Computation Design for Probabilistic Semantic Communications
• Semantic Information Recovery in Wireless Networks
• Recent Advances in Deep Learning for Channel Coding: A Survey
• xURLLC-Aware Service Provisioning in Vehicular Networks: A Semantic Communication Perspective
• Semantic Communications With AI Tasks
• Semantic Communication with Probability Graph: A Joint Communication and Computation Design
• Mulsemedia Communication Research Challenges for Metaverse in 6G Wireless Systems
• A Joint Communication and Computation Design for Semantic Wireless Communication with Probability Graph
• Knowledge Distillation Based Semantic Communications For Multiple Users
• Dynamic Multi-time Scale User Admission and Resource Allocation for Semantic Extraction in MEC Systems
• Latent Diffusion Model-Enabled Low-Latency Semantic Communication in the Presence of Semantic Ambiguities and Wireless Channel Noises
• Physical Layer Security for Integrated Sensing and Communication: A Survey
• Hybrid Semantic-Shannon Communications
• Semantic Communication with Conceptual Spaces
• Semantic Information Extraction for Text Data with Probability Graph
• Goal-oriented Semantic Communications for Robotic Waypoint Transmission: The Value and Age of Information Approach
• FAST: Fidelity-Adjustable Semantic Transmission over Heterogeneous Wireless Networks
• Large-Language-Model Enabled Semantic Communication Systems
• Multi-Task Semantic Communication With Graph Attention-Based Feature Correlation Extraction
• Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networks
• Attention-aware Semantic Communications for Collaborative Inference
• Wireless Resource Optimization in Hybrid Semantic/Bit Communication Networks
• Goal-Oriented Wireless Communication Resource Allocation for Cyber-Physical Systems
• A Monolithic Cybersecurity Architecture for Power Electronic Systems
• Delay-Aware Digital Twin Synchronization in Mobile Edge Networks with Semantic Communications
• Two-Way Semantic Transmission of Images without Feedback
• Computational Offloading in Semantic-Aware Cloud-Edge-End Collaborative Networks
• Computing Offloading and Semantic Compression for Intelligent Computing Tasks in MEC Systems
• Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challenges
• A Lite Distributed Semantic Communication System for Internet of Things
• Semantic Communication for Cooperative Multi-Task Processing over Wireless Networks
• Knowledge-Aware Semantic Communication System Design and Data Allocation
• Explicit Semantic-Base-Empowered Communications for 6G Mobile Networks
• Knowledge-Aware Semantic Communication System Design
• Enhancing Communication Efficiency of Semantic Transmission via Joint Processing Technique
• Information Bottleneck-Inspired Type Based Multiple Access for Remote Estimation in IoT Systems
• Transmit What You Need: Task-Adaptive Semantic Communications for Visual Information
• Delay-Aware Semantic Sampling in Power Electronic Systems
• Integrated Distributed Semantic Communication and Over-the-air Computation for Cooperative Spectrum Sensing
• A Physical Layer Security Framework for IRS-Assisted Integrated Sensing and Semantic Communication Systems
• Semantic Communication Systems for Speech Transmission
• Model-free Reinforcement Learning of Semantic Communication by Stochastic Policy Gradient
• Internet of Things (IoT) Connectivity in 6G: An Interplay of Time, Space, Intelligence, and Value
• Power-Efficient Optimization for Coexisting Semantic and Bit-Based Users in NOMA Networks
• Topos and Stacks of Deep Neural Networks
• A Semantic Generalization of Shannon's Information Theory and Applications
• Multi-Modal Fusion-Based Multi-Task Semantic Communication System
• Deep Learning-Based CSI Feedback for Beamforming in Single- and Multi-cell Massive MIMO Systems
• A Mathematical Theory for Learning Semantic Languages by Abstract Learners
• Semantic Feature Division Multiple Access for Digital Semantic Broadcast Channels
• Semantic Communications for Speech Signals
• Shuffling for Semantic Secrecy
• Hybrid NOMA Assisted Heterogeneous Semantic and Bit Users Communication
• Logical Information Cells I
• Integrating Semantic Communication and Human Decision-Making into an End-to-End Sensing-Decision Framework
• Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications
• Foundation Models for Generalizable Semantic and Goal-Oriented Communication
• In-Context Source and Channel Coding
• Reinforcement-Learned Unequal Error Protection for Quantized Semantic Embeddings
• Robustness in Wireless Distributed Learning: An Information-Theoretic Analysis
• Semantic Communications for Speech Recognition