25 citations · 56 across the 13 of their papers we have counts for
5 papers · 1 filter
Hand-Object Interaction Pretraining from Videos
Himanshu Gaurav Singh, Antonio Loquercio, Carmelo Sferrazza +4
We present an approach to learn general robot manipulation priors from 3D hand-object interaction trajectories. We build a framework to use in-the-wild videos to generate sensorimo…
Semi-Supervised One-Shot Imitation Learning
Philipp Wu, Kourosh Hakhamaneshi, Yuqing Du +3
One-shot Imitation Learning~(OSIL) aims to imbue AI agents with the ability to learn a new task from a single demonstration. To supervise the learning, OSIL typically requires a pr…
From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Control
Yide Shentu, Philipp Wu, Aravind Rajeswaran +1
Hierarchical control for robotics has long been plagued by the need to have a well defined interface layer to communicate between high-level task planners and low-level policies. W…
Twisting Lids Off with Two Hands
Toru Lin, Zhao-Heng Yin, Haozhi Qi +2
Manipulating objects with two multi-fingered hands has been a long-standing challenge in robotics, due to the contact-rich nature of many manipulation tasks and the complexity inhe…
Video as the New Language for Real-World Decision Making
Sherry Yang, Jacob Walker, Jack Parker-Holder +5
Both text and video data are abundant on the internet and support large-scale self-supervised learning through next token or frame prediction. However, they have not been equally l…