Achieve What You Imagined: Learning to Align Actions with Visual Plans

Yuheng Qiao, Ziran Wei, Xiaohan Wang +5

World-action models can jointly predict future visual observations and robot actions. However, discrepancies may exist between their visual predictions and the consequences implied…