5 papers
Learning 3D Affordances for Blade Insertion in Cluttered Stowing
Tianyu Li, Harpreet Sawhney, Minju Jung +3
Many manipulation tasks require reasoning about free-space affordances: discovering volumes where an extended rigid tool can safely navigate, complementary to surface contact affor…
Visual Foresight for Robotic Stow: A Diffusion-Based World Model from Sparse Snapshots
Lijun Zhang, Nikhil Chacko, Petter Nilsson +8
Automated warehouses execute millions of stow operations, where robots place objects into storage bins. For these systems it is valuable to anticipate how a bin will look from the…
ShapeICP: Iterative Category-level Object Pose and Shape Estimation from Depth
Yihao Zhang, Harpreet S. Sawhney, John J. Leonard
Category-level object pose and shape estimation from a single depth image has recently drawn research attention due to its potential utility for tasks such as robotics manipulation…
Schema-Guided Scene-Graph Reasoning based on Multi-Agent Large Language Model System
Yiye Chen, Harpreet Sawhney, Nicholas Gydé +4
Scene graphs have emerged as a structured and serializable environment representation for grounded spatial reasoning with Large Language Models (LLMs). In this work, we propose SG^…
How Do I Do That? Synthesizing 3D Hand Motion and Contacts for Everyday Interactions
Aditya Prakash, Benjamin Lundell, Dmitry Andreychuk +3
We tackle the novel problem of predicting 3D hand motion and contact maps (or Interaction Trajectories) given a single RGB view, action text, and a 3D contact point on the object a…