Exploration of Quantum Neural Architecture by Mixing Quantum Neuron Designs

Abstract

With the constant increase of the number of quantum bits (qubits) in the actual quantum computers, implementing and accelerating the prevalent deep learning on quantum computers are becoming possible. Along with this trend, there emerge quantum neural architectures based on different designs of quantum neurons. A fundamental question in quantum deep learning arises: what is the best quantum neural architecture? Inspired by the design of neural architectures for classical computing which typically employs multiple types of neurons, this paper makes the very first attempt to mix quantum neuron designs to build quantum neural architectures. We observe that the existing quantum neuron designs may be quite different but complementary, such as neurons from variational quantum circuits (VQC) and Quantumflow. More specifically, VQC can apply real-valued weights but suffer from being extended to multiple layers, while QuantumFlow can build a multi-layer network efficiently, but is limited to use binary weights. To take their respective advantages, we propose to mix them together and figure out a way to connect them seamlessly without additional costly measurement. We further investigate the design principles to mix quantum neurons, which can provide guidance for quantum neural architecture exploration in the future. Experimental results demonstrate that the identified quantum neural architectures with mixed quantum neurons can achieve 90.62% of accuracy on the MNIST dataset, compared with 52.77% and 69.92% on the VQC and QuantumFlow, respectively.

References in corpus (5)

• Neural Architecture Search with Reinforcement Learning
• Language Models are Few-Shot Learners
• Nonlinear Quantum Neuron: A Fundamental Building Block for Quantum Neural Networks
• Dancing along Battery: Enabling Transformer with Run-time Reconfigurability on Mobile Devices
• Enabling On-Device Self-Supervised Contrastive Learning With Selective Data Contrast

Cited by in corpus (2)

• Computing-In-Memory Neural Network Accelerators for Safety-Critical Systems: Can Small Device Variations Be Disastrous?
• Can Noise on Qubits Be Learned in Quantum Neural Network? A Case Study on QuantumFlow