Robust optimization for quantum reinforcement learning control using partial observations
arXiv:2206.14420 · doi:10.1103/PhysRevA.105.062443
Abstract
The current quantum reinforcement learning control models often assume that the quantum states are known a priori for control optimization. However, full observation of quantum state is experimentally infeasible due to the exponential scaling of the number of required quantum measurements on the number of qubits. In this paper, we investigate a robust reinforcement learning method using partial observations to overcome this difficulty. This control scheme is compatible with near-term quantum devices, where the noise is prevalent and predetermining the dynamics of quantum state is practically impossible. We show that this simplified control scheme can achieve similar or even better performance when compared to the conventional methods relying on full observation. We demonstrate the effectiveness of this scheme on examples of quantum state control and quantum approximate optimization algorithm. It has been shown that high-fidelity state control can be achieved even if the noise amplitude is at the same level as the control amplitude. Besides, an acceptable level of optimization accuracy can be achieved for QAOA with noisy control Hamiltonian. This robust control optimization model can be trained to compensate the uncertainties in practical quantum computing.
References in corpus (31)
- Addressing Function Approximation Error in Actor-Critic Methods
- A Quantum Approximate Optimization Algorithm
- Perfect state transfer in quantum spin networks
- Quantum Approximate Optimization Algorithm: Performance, Mechanism, and Implementation on Near-Term Devices
- A Review of Perfect State Transfer and its Application as a Constructive Tool
- Reinforcement Learning in Different Phases of Quantum Control
- Comparing, Optimising and Benchmarking Quantum Control Algorithms in a Unifying Programming Framework
- Soundness and completeness of quantum root-mean-square errors
- Reinforcement Learning with Neural Networks for Quantum Feedback
- Fidelity-based Probabilistic Q-learning for Control of Quantum Systems
- A Quantum Approximate Optimization Algorithm Applied to a Bounded Occurrence Constraint Problem
- Self-guided quantum tomography
- Deep Reinforcement Learning for Quantum Gate Control
- Coherent Transport of Quantum States by Deep Reinforcement Learning
- Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential
- Automatic spin-chain learning to explore the quantum speed limit
- Reinforcement Learning assisted Quantum Optimization
- Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator
- Measurement-based adaptation protocol with quantum reinforcement learning
- Robust Quantum Control in Games: an Adversarial Learning Approach
- Krotov Method for Optimal Control in Closed Quantum Systems
- A differentiable programming method for quantum control
- Breaking Adiabatic Quantum Control with Deep Learning
- Policy Gradient based Quantum Approximate Optimization Algorithm
- Robust Quantum Control against Clock Noises in Multi-Qubit Systems
- Deep reinforcement learning for robust quantum optimization
- Automated quantum programming via reinforcement learning for combinatorial optimization
- Automatic Depth Optimization for Quantum Approximate Optimization Algorithm
- Experimentally Realizing Efficient Quantum Control with Reinforcement Learning
- Manipulation of Spin Dynamics by Deep Reinforcement Learning Agent
- Quantum Stream Learning