CLAD: Constrained Latent Action Diffusion for Vision-Language Procedure Planning

Lei Shi, Andreas Bulling

We propose CLAD, a Constrained Latent Action Diffusion model for vision-language procedure planning in instructional videos. Procedure planning is the challenging task of predictin…