Quantum Federated Learning for Multimodal Data: A Modality-Agnostic Approach

Abstract

Quantum federated learning (QFL) has been recently introduced to enable a distributed privacy-preserving quantum machine learning (QML) model training across quantum processors (clients). Despite recent research efforts, existing QFL frameworks predominantly focus on unimodal systems, limiting their applicability to real-world tasks that often naturally involve multiple modalities. To fill this significant gap, we present for the first time a novel multimodal approach specifically tailored for the QFL setting with the intermediate fusion using quantum entanglement. Furthermore, to address a major bottleneck in multimodal QFL, where the absence of certain modalities during training can degrade model performance, we introduce a Missing Modality Agnostic (MMA) mechanism that isolates untrained quantum circuits, ensuring stable training without corrupted states. Simulation results demonstrate that the proposed multimodal QFL method with MMA yields an improvement in accuracy of 6.84% in independent and identically distributed (IID) and 7.25% in non-IID data distributions compared to the state-of-the-art methods.

This paper was presented at BEAM with CVPR 2025

References in corpus (14)

• Quantum Machine Learning
• Variational Quantum Algorithms
• Supervised learning with quantum enhanced feature spaces
• Federated Learning for Internet of Things: A Comprehensive Survey
• Parameterized quantum circuits as machine learning models
• Circuit-centric quantum classifiers
• Power of data in quantum machine learning
• Deep learning for affective computing: text-based emotion recognition in decision support
• Fundamental limits of quantum error mitigation
• Mid-circuit correction of correlated phase errors using an array of spectator qubits
• FedQNN: Federated Learning using Quantum Neural Networks
• Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation
• Electrical Load Forecasting over Multihop Smart Metering Networks with Federated Learning
• Quantum Error Mitigation via Quantum-Noise-Effect Circuit Groups