Estimation of effective temperatures in quantum annealers for sampling applications: A case study with possible applications in deep learning

Abstract

An increase in the efficiency of sampling from Boltzmann distributions would have a significant impact on deep learning and other machine-learning applications. Recently, quantum annealers have been proposed as a potential candidate to speed up this task, but several limitations still bar these state-of-the-art technologies from being used effectively. One of the main limitations is that, while the device may indeed sample from a Boltzmann-like distribution, quantum dynamical arguments suggest it will do so with an {\it instance-dependent} effective temperature, different from its physical temperature. Unless this unknown temperature can be unveiled, it might not be possible to effectively use a quantum annealer for Boltzmann sampling. In this work, we propose a strategy to overcome this challenge with a simple effective-temperature estimation algorithm. We provide a systematic study assessing the impact of the effective temperatures in the learning of a special class of a restricted Boltzmann machine embedded on quantum hardware, which can serve as a building block for deep-learning architectures. We also provide a comparison to $k$-step contrastive divergence (CD-$k$) with $k$ up to 100. Although assuming a suitable fixed effective temperature also allows us to outperform one step contrastive divergence (CD-1), only when using an instance-dependent effective temperature do we find a performance close to that of CD-100 for the case studied here.

New appendix and figure comparing to other temperature estimation techniques from the statistical physics community. 15 pages, 6 figures

References in corpus (5)

• Application of Quantum Annealing to Training of Deep Neural Networks
• Bayesian Network Structure Learning Using Quantum Annealing
• A Quantum Annealing Approach for Fault Detection and Diagnosis of Graph-Based Systems
• Advanced Mean Field Theory of Restricted Boltzmann Machine
• Ensemble annealing of complex physical systems

Cited by in corpus (103)

• Quantum Machine Learning
• Noisy intermediate-scale quantum (NISQ) algorithms
• Adiabatic Quantum Computing
• Quantum computing for finance: overview and prospects
• Quantum machine learning: a classical perspective
• A generative modeling approach for benchmarking and training shallow quantum circuits
• Quantum Boltzmann Machine
• Quantum computing for finance
• Opportunities and challenges for quantum-assisted machine learning in near-term quantum computers
• The prospects of quantum computing in computational molecular biology
• Expanding the horizon of automated metamaterials discovery via quantum annealing
• Quantum Hopfield neural network
• Quantum reservoir processing
• Tomography and Generative Data Modeling via Quantum Boltzmann Training
• Quantum Variational Autoencoder
• Quantum singular value decomposition of non-sparse low-rank matrices
• Power of Pausing: Advancing Understanding of Thermalization in Experimental Quantum Annealers
• Quantum Software Engineering: Landscapes and Horizons
• Quantum-Assisted Learning of Hardware-Embedded Probabilistic Graphical Models
• Quantum Machine Learning in High Energy Physics
• A NASA Perspective on Quantum Computing: Opportunities and Challenges
• Improving solutions by embedding larger subproblems in a D-Wave quantum annealer
• Quantum-assisted Helmholtz machines: A quantum-classical deep learning framework for industrial datasets in near-term devices
• Quantum-enhanced Markov chain Monte Carlo
• Scaling and diabatic effects in quantum annealing with a D-Wave device
• Dissipative quantum bifurcation machine: Quantum heating of coupled nonlinear oscillators
• Quantum Computing Assisted Deep Learning for Fault Detection and Diagnosis in Industrial Process Systems
• Reconstructing quantum states with quantum reservoir networks
• A Direct Mapping of Max k-SAT and High Order Parity Checks to a Chimera Graph
• Basic Elements for Simulations of Standard Model Physics with Quantum Annealers: Multigrid and Clock States
• Quantum autoencoders via quantum adders with genetic algorithms
• Global warming: Temperature estimation in annealers
• Training and Classification using a Restricted Boltzmann Machine on the D-Wave 2000Q
• Variational inference with a quantum computer
• Quantum Computing for Quantum Tunnelling
• Supervised Quantum Learning without Measurements
• Quantum search with hybrid adiabatic-quantum walk algorithms and realistic noise
• Travel time optimization on multi-AGV routing by reverse annealing
• Machine learning \& artificial intelligence in the quantum domain
• Thermalization, freeze-out and noise: deciphering experimental quantum annealers
• Quantum computing for chemistry and physics applications from a Monte Carlo perspective
• Training a quantum annealing based restricted Boltzmann machine on cybersecurity data
• Towards optimization of photonic-crystal surface-emitting lasers via quantum annealing
• Completely Quantum Neural Networks
• Programmable Quantum Annealers as Noisy Gibbs Samplers
• Mean field analysis of reverse annealing for code-division multiple-access multiuser detection
• Multiqubit and multilevel quantum reinforcement learning with quantum technologies
• Quantum neural networks to simulate many-body quantum systems
• High-quality Thermal Gibbs Sampling with Quantum Annealing Hardware
• Quantum Enhanced Inference in Markov Logic Networks
• Exact representations of many body interactions with RBM neural networks
• Quantum-assisted associative adversarial network: Applying quantum annealing in deep learning
• Leveraging Adiabatic Quantum Computation for Election Forecasting
• Quantum Optimisation of Complex Systems with a Quantum Annealer
• Evaluating Ising Processing Units with Integer Programming
• Equation Planting: A Tool for Benchmarking Ising Machines
• Optimal Thermometers with Spin Networks
• Quantum algorithms for scientific computing
• Practical designs for permutation symmetric problem Hamiltonians on hypercubes
• Sampling Rare Conformational Transitions with a Quantum Computer
• Comparing the effects of Boltzmann machines as associative memory in Generative Adversarial Networks between classical and quantum sampling
• Signatures of Open and Noisy Quantum Systems in Single-Qubit Quantum Annealing
• Perils of Embedding for Sampling Problems
• Efficiency Optimization in Quantum Computing: Balancing Thermodynamics and Computational Performance
• Virtual Screening of Chemical Space based on Quantum Annealing
• Viewing Vanilla Quantum Annealing Through Spin Glasses
• Estimating the Density of States of Frustrated Spin Systems
• Cooperative quantum information erasure
• Realization of a quantum neural network using repeat-until-success circuits in a superconducting quantum processor
• Guided quantum walk
• Searching for interstellar quantum communications
• Exploring Unsupervised Anomaly Detection with Quantum Boltzmann Machines in Fraud Detection
• Three Learning Stages and Accuracy-Efficiency Tradeoff of Restricted Boltzmann Machines
• From Ansätze to Z-gates: a NASA View of Quantum Computing
• Error measurements for a quantum annealer using the one-dimensional Ising model with twisted boundaries
• A hybrid quantum-classical approach for inference on restricted Boltzmann machines
• Towards Transfer Learning for Large-Scale Image Classification Using Annealing-based Quantum Boltzmann Machines
• Perils of Embedding for Quantum Sampling
• Accelerating equilibrium spin-glass simulations using quantum annealers via generative deep learning
• Exploring the neighborhood of 1-layer QAOA with Instantaneous Quantum Polynomial circuits
• Modernizing Quantum Annealing II: Genetic algorithms with the Inference Primitive Formalism
• Measuring energy by measuring any other observable
• Critical properties of dissipative quantum spin systems in finite dimensions
• Quantum-assisted finite-element design optimization
• QFitter -- A Quantum Fitting Framework Applied to Effective Field Theories
• Online calibration scheme for training restricted Boltzmann machines with quantum annealing
• Geometry and symmetry in quantum Boltzmann machine
• Applications of Quantum Annealing in Statistics
• Optimization of ionic configurations in battery materials by quantum annealing
• Restricted Boltzmann Machines for galaxy morphology classification with a quantum annealer
• Quantum-inspired annealers as Boltzmann generators for machine learning and statistical physics
• Decoding quantum error correction with Ising model hardware
• Systematic comparison of deep belief network training using quantum annealing vs. classical techniques
• Classical Criticality via Quantum Annealing
• Sampling Problems on a Quantum Computer
• Noise-injected analog Ising machines enable ultrafast statistical sampling and machine learning
• Learning-Driven Annealing with Adaptive Hamiltonian Modification for Solving Large-Scale Problems on Quantum Devices
• Solving Inequality-Constrained Binary Optimization Problems on Quantum Annealer
• Simulating charging characteristics of lithium iron phosphate by electro-ionic optimization on a quantum annealer
• Diabatic quantum annealing for training energy-based generative models
• On Sampling and Inference using Quantum Algorithms
• Noise-Resilient Quantum Reinforcement Learning
• Quantum annealing and condensed matter physics