Proprioception Enhances Vision Language Model in Generating Captions and Subtask Segmentations for Robot Task

Kanata Suzuki, Shota Shimizu, Tetsuya Ogata

From the perspective of future developments in robotics, it is crucial to verify whether foundation models trained exclusively on offline data, such as images and language, can und…