Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problems

Abstract

We present a novel deep reinforcement learning method to learn construction heuristics for vehicle routing problems. In specific, we propose a Multi-Decoder Attention Model (MDAM) to train multiple diverse policies, which effectively increases the chance of finding good solutions compared with existing methods that train only one policy. A customized beam search strategy is designed to fully exploit the diversity of MDAM. In addition, we propose an Embedding Glimpse layer in MDAM based on the recursive nature of construction, which can improve the quality of each policy by providing more informative embeddings. Extensive experiments on six different routing problems show that our method significantly outperforms the state-of-the-art deep learning based models.

Accepted by AAAI 2021

Cited by in corpus (8)

• Deep Reinforcement Learning for Solving the Heterogeneous Capacitated Vehicle Routing Problem
• Heterogeneous Attentions for Solving Pickup and Delivery Problem via Deep Reinforcement Learning
• NeuroLKH: Combining Deep Learning Model with Lin-Kernighan-Helsgaun Heuristic for Solving the Traveling Salesman Problem
• Learning Collaborative Policies to Solve NP-hard Routing Problems
• Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformer
• Learning Large Neighborhood Search Policy for Integer Programming
• Deep Reinforcement Learning for Demand Driven Services in Logistics and Transportation Systems: A Survey
• Supervised Off-Policy Ranking