Diverse Controllable Diffusion Policy with Signal Temporal Logic

Abstract

Generating realistic simulations is critical for autonomous system applications such as self-driving and human-robot interactions. However, driving simulators nowadays still have difficulty in generating controllable, diverse, and rule-compliant behaviors for road participants: Rule-based models cannot produce diverse behaviors and require careful tuning, whereas learning-based methods imitate the policy from data but are not designed to follow the rules explicitly. Besides, the real-world datasets are by nature "single-outcome", making the learning method hard to generate diverse behaviors. In this paper, we leverage Signal Temporal Logic (STL) and Diffusion Models to learn controllable, diverse, and rule-aware policy. We first calibrate the STL on the real-world data, then generate diverse synthetic data using trajectory optimization, and finally learn the rectified diffusion policy on the augmented dataset. We test on the NuScenes dataset and our approach can achieve the most diverse rule-compliant trajectories compared to other baselines, with a runtime 1/17X to the second-best approach. In the closed-loop testing, our approach reaches the highest diversity, rule satisfaction rate, and the least collision rate. Our method can generate varied characteristics conditional on different STL parameters in testing. A case study on human-robot encounter scenarios shows our approach can generate diverse and closed-to-oracle trajectories. The annotation tool, augmented dataset, and code are available at https://github.com/mengyuest/pSTL-diffusion-policy.

Accepted by IEEE Robotics and Automation Letters (RA-L), October 2024

References in corpus (6)

• Enhanced Intelligent Driver Model to Access the Impact of Driving Strategies on Traffic Capacity
• A Review of Tracking, Prediction and Decision Making Methods for Autonomous Driving
• Modeling Human Driving Behavior through Generative Adversarial Imitation Learning
• Movement Primitive Diffusion: Learning Gentle Robotic Manipulation of Deformable Objects
• Diverse Multiple Trajectory Prediction Using a Two-stage Prediction Network Trained with Lane Loss
• Scaling Planning for Automated Driving using Simplistic Synthetic Data

Cited by in corpus (1)

• STLCG++: A Masking Approach for Differentiable Signal Temporal Logic Specification