2 citations · 4 across the 13 of their papers we have counts for
14 papers · 1 filter
EyeRobot 2.0: Active Gaze for Precise Manipulation without Wrist Cameras
Kush Hari, Justin Kerr, Nidhya Shivakumar +7
Inspired by human vision, we introduce a framework using active gaze to enable fine-grained bimanual manipulation with only a single stereo camera. EyeRobot 2.0 physically attends…
Open-H-Embodiment: A Large-Scale Dataset for Enabling Foundation Models in Medical Robotics
Open-H-Embodiment Consortium, :, Nigel Nelson +213
Autonomous medical robots hold promise to improve patient outcomes, reduce provider workload, democratize access to care, and enable superhuman precision. However, autonomous medic…
STITCH 2.0: Extending Augmented Suturing with EKF Needle Estimation and Thread Management
Kush Hari, Ziyang Chen, Hansoul Kim +1
Surgical suturing is a high-precision task that impacts patient healing and scarring. Suturing skill varies widely between surgeons, highlighting the need for robot assistance. Pre…
Eye, Robot: Learning to Look to Act with a BC-RL Perception-Action Loop
Justin Kerr, Kush Hari, Ethan Weber +5
Humans do not passively observe the visual world -- we actively look in order to act. Motivated by this principle, we introduce EyeRobot, a robotic system with gaze behavior that e…
Robo-DM: Data Management For Large Robot Datasets
Kaiyuan Chen, Letian Fu, David Huang +9
Recent results suggest that very large datasets of teleoperated robot demonstrations can be used to train transformer-based models that have the potential to generalize to new scen…
SuFIA-BC: Generating High Quality Demonstration Data for Visuomotor Policy Learning in Surgical Subtasks
Masoud Moghani, Nigel Nelson, Mohamed Ghanem +6
Behavior cloning facilitates the learning of dexterous manipulation skills, yet the complexity of surgical environments, the difficulty and expense of obtaining patient data, and r…
Persistent Object Gaussian Splat (POGS) for Tracking Human and Robot Manipulation of Irregularly Shaped Objects
Justin Yu, Kush Hari, Karim El-Refai +6
Tracking and manipulating irregularly-shaped, previously unseen objects in dynamic environments is important for robotic applications in manufacturing, assembly, and logistics. Rec…
FogROS2-FT: Fault Tolerant Cloud Robotics
Kaiyuan Chen, Kush Hari, Trinity Chung +8
Cloud robotics enables robots to offload complex computational tasks to cloud servers for performance and ease of management. However, cloud compute can be costly, cloud services c…
Language-Embedded Gaussian Splats (LEGS): Incrementally Building Room-Scale Representations with a Mobile Robot
Justin Yu, Kush Hari, Kishore Srinivas +9
Building semantic 3D maps is valuable for searching for objects of interest in offices, warehouses, stores, and homes. We present a mapping system that incrementally builds a Langu…
ORBIT-Surgical: An Open-Simulation Framework for Learning Surgical Augmented Dexterity
Qinxi Yu, Masoud Moghani, Karthik Dharmarajan +8
Physics-based simulations have accelerated progress in robot learning for driving, manipulation, and locomotion. Yet, a fast, accurate, and robust surgical simulation environment r…
STITCH: Augmented Dexterity for Suture Throws Including Thread Coordination and Handoffs
Kush Hari, Hansoul Kim, Will Panitch +6
We present STITCH: an augmented dexterity pipeline that performs Suture Throws Including Thread Coordination and Handoffs. STITCH iteratively performs needle insertion, thread swee…
Lifelong LERF: Local 3D Semantic Inventory Monitoring Using FogROS2
Adam Rashid, Chung Min Kim, Justin Kerr +11
Inventory monitoring in homes, factories, and retail stores relies on maintaining data despite objects being swapped, added, removed, or moved. We introduce Lifelong LERF, a method…
Mirage: Cross-Embodiment Zero-Shot Policy Transfer with Cross-Painting
Lawrence Yunliang Chen, Kush Hari, Karthik Dharmarajan +3
The ability to reuse collected data and transfer trained policies between robots could alleviate the burden of additional data collection and training. While existing approaches su…
FogROS2-Config: Optimizing Latency and Cost for Multi-Cloud Robot Applications
Kaiyuan Chen, Kush Hari, Rohil Khare +6
Cloud service providers provide over 50,000 distinct and dynamically changing set of cloud server options. To help roboticists make cost-effective decisions, we present FogROS2-Con…