7 citations · 16 across the 12 of their papers we have counts for
13 papers
Memory Retrieval in Visuomotor Policies for Long-Horizon Robot Control
Rutav Shah, Yisu Li, Femi Bello +2
General-purpose robots operating in partially observable environments, such as homes, require memory to support autonomy. They must recall diverse information from the past, such a…
R-C2: Cycle-Consistent Reinforcement Learning Improves Multimodal Reasoning
Zirui Zhang, Haoyu Dong, Kexin Pei +1
Robust perception and reasoning require consistency across sensory modalities. Yet current multimodal models often violate this principle, yielding contradictory predictions for vi…
LLM-GROP: Visually Grounded Robot Task and Motion Planning with Large Language Models
Xiaohan Zhang, Yan Ding, Yohei Hayamizu +6
Task planning and motion planning are two of the most important problems in robotics, where task planning methods help robots achieve high-level goals and motion planning methods m…
MimicDroid: In-Context Learning for Humanoid Robot Manipulation from Human Play Videos
Rutav Shah, Shuijing Liu, Qi Wang +5
We aim to enable humanoid robots to efficiently solve new manipulation tasks from a few video examples. In-context learning (ICL) is a promising framework for achieving this goal d…
FORTE: Tactile Force and Slip Sensing on Compliant Fingers for Delicate Manipulation
Siqi Shang, Mingyo Seo, Yuke Zhu +1
Handling fragile objects remains a major challenge for robotic manipulation. Tactile sensing and soft robotics can improve delicate object handling, but typically involve high inte…
LEGATO: Cross-Embodiment Imitation Using a Grasping Tool
Mingyo Seo, H. Andy Park, Shenli Yuan +2
Cross-embodiment imitation learning enables policies trained on specific embodiments to transfer across different robots, unlocking the potential for large-scale imitation learning…
SPOT: SE(3) Pose Trajectory Diffusion for Object-Centric Manipulation
Cheng-Chun Hsu, Bowen Wen, Jie Xu +5
We introduce SPOT, an object-centric imitation learning framework. The key idea is to capture each task by an object-centric representation, specifically the SE(3) object pose traj…
Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions
Zhenyu Jiang, Yuqi Xie, Jinhan Li +3
Humanoid robots, with their human-like embodiment, have the potential to integrate seamlessly into human environments. Critical to their coexistence and cooperation with humans is…
OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitation
Jinhan Li, Yifeng Zhu, Yuqi Xie +4
We study the problem of teaching humanoid robots manipulation skills by imitating from single video demonstrations. We introduce OKAMI, a method that generates a manipulation plan…
DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning
Zhenyu Jiang, Yuqi Xie, Kevin Lin +5
Imitation learning from human demonstrations is an effective means to teach robots manipulation skills. But data acquisition is a major bottleneck in applying this paradigm more br…
HOVER: Versatile Neural Whole-Body Controller for Humanoid Robots
Tairan He, Wenli Xiao, Toru Lin +9
Humanoid whole-body control requires adapting to diverse tasks such as navigation, loco-manipulation, and tabletop manipulation, each demanding a different mode of control. For exa…
KinScene: Model-Based Mobile Manipulation of Articulated Scenes
Cheng-Chun Hsu, Ben Abbatematteo, Zhenyu Jiang +3
Sequentially interacting with articulated objects is crucial for a mobile manipulator to operate effectively in everyday environments. To enable long-horizon tasks involving articu…
PRESTO: Fast Motion Planning Using Diffusion Models Based on Key-Configuration Environment Representation
Mingyo Seo, Yoonyoung Cho, Yoonchang Sung +3
We introduce a learning-guided motion planning framework that generates seed trajectories using a diffusion model for trajectory optimization. Given a workspace, our method approxi…