Robo-MUTUAL: Robotic Multimodal Task Specification via Unimodal Learning

Jianxiong Li, Zhihao Wang, Jinliang Zheng +8

Multimodal task specification is essential for enhanced robotic performance, where \textit{Cross-modality Alignment} enables the robot to holistically understand complex task instr…