Vision-Based Manipulators Need to Also See from Their Hands

Kyle Hsu, Moo Jin Kim, Rafael Rafailov +2

We study how the choice of visual perspective affects learning and generalization in the context of physical manipulation from raw sensor observations. Compared with the more commo…