Tensor Network Estimation of Distribution Algorithms

Abstract

Tensor networks are a tool first employed in the context of many-body quantum physics that now have a wide range of uses across the computational sciences, from numerical methods to machine learning. Methods integrating tensor networks into evolutionary optimization algorithms have appeared in the recent literature. In essence, these methods can be understood as replacing the traditional crossover operation of a genetic algorithm with a tensor network-based generative model. We investigate these methods from the point of view that they are Estimation of Distribution Algorithms (EDAs). We find that optimization performance of these methods is not related to the power of the generative model in a straightforward way. Generative models that are better (in the sense that they better model the distribution from which their training data is drawn) do not necessarily result in better performance of the optimization algorithm they form a part of. This raises the question of how best to incorporate powerful generative models into optimization routines. In light of this we find that adding an explicit mutation operator to the output of the generative model often improves optimization performance.

References in corpus (10)

• The density-matrix renormalization group in the age of matrix product states
• A Practical Introduction to Tensor Networks: Matrix Product States and Projected Entangled Pair States
• Low-Rank Tensor Networks for Dimensionality Reduction and Large-Scale Optimization Problems: Perspectives and Challenges PART 1
• Tensor Networks for Dimensionality Reduction and Large-Scale Optimizations. Part 2 Applications and Future Perspectives
• Perfect Sampling with Unitary Tensor Networks
• Tensor Network Algorithms: a Route Map
• Tree Tensor Networks for Generative Modeling
• Learning tensor networks with tensor cross interpolation: new algorithms and libraries
• Tensor networks for interpretable and efficient quantum-inspired machine learning
• Cons-training Tensor Networks: Embedding and Optimization Over Discrete Linear Constraints

Cited by in corpus (1)

• Variational matrix product states for combinatorial optimization