A Recipe for Creating Multimodal Aligned Datasets for Sequential Tasks

Angela S. Lin, Sudha Rao, Asli Celikyilmaz +4

Many high-level procedural tasks can be decomposed into sequences of instructions that vary in their order and choice of tools. In the cooking domain, the web offers many partially…