Point Tracking Improves World Action Models

Jiarui Guan, Wenshuai Zhao, Yue Pei +3

Robot policy learning benefits from world-action models that capture environment dynamics, but pixel-level prediction entangles dynamics with nuisance factors such as lighting and…