Global Search for Optimal Low Thrust Spacecraft Trajectories using Diffusion Models and the Indirect Method

Abstract

Long time-duration low-thrust nonlinear optimal spacecraft trajectory global search is a computationally and time expensive problem characterized by clustering patterns in locally optimal solutions. During preliminary mission design, mission parameters are subject to frequent changes, necessitating that trajectory designers efficiently generate high-quality control solutions for these new scenarios. Generative machine learning models can be trained to learn how the solution structure varies with respect to a conditional parameter, thereby accelerating the global search for missions with updated parameters. In this work, state-of-the-art diffusion models are integrated with the indirect approach for trajectory optimization within a global search framework. This framework is tested on two low-thrust transfers of different complexity in the circular restricted three-body problem. By generating and analyzing a training data set, we develop mathematical relations and techniques to understand the complex structures in the costate domain of locally optimal solutions for these problems. A diffusion model is trained on this data and successfully accelerates the global search for both problems. The model predicts how the costate solution structure changes, based on the maximum spacecraft thrust magnitude. Warm-starting a numerical solver with diffusion model samples for the costates at the initial time increases the number of solutions generated per minute for problems with unseen thrust magnitudes by one to two orders of magnitude in comparison to samples from a uniform distribution and from an adjoint control transformation.

References in corpus (15)

• Denoising Diffusion Probabilistic Models
• Diffusion Models Beat GANs on Image Synthesis
• Deep Unsupervised Learning using Nonequilibrium Thermodynamics
• Generative Modeling by Estimating Gradients of the Data Distribution
• Classifier-Free Diffusion Guidance
• Human Motion Diffusion Model
• Diffusion Policies as an Expressive Policy Class for Offline Reinforcement Learning
• Diffusion Policy: Visuomotor Policy Learning via Action Diffusion
• DiffuSolve: Diffusion-based Solver for Non-convex Trajectory Optimization
• Consistency Models as a Rich and Efficient Policy Class for Reinforcement Learning
• Amortized Global Search for Efficient Preliminary Trajectory Design with Deep Generative Models
• Global Search of Optimal Spacecraft Trajectories using Amortization and Deep Generative Models
• Diffusion World Model: Future Modeling Beyond Step-by-Step Rollout for Offline Reinforcement Learning
• Learning Optimal Control and Dynamical Structure of Global Trajectory Search Problems with Diffusion Models
• Constraint-Aware Diffusion Models for Trajectory Optimization