177 citations · 724 across the 71 of their papers we have counts for
17 papers · 1 filter
FineControlNet: Fine-level Text Control for Image Generation with Spatially Aligned Text Control Injection
Hongsuk Choi, Isaac Kasahara, Selim Engin +3
Recently introduced ControlNet has the ability to steer the text-driven image generation process with geometric input such as human 2D pose, or edge features. While ControlNet prov…
VioLA: Aligning Videos to 2D LiDAR Scans
Jun-Jee Chao, Selim Engin, Nikhil Chavan-Dafle +2
We study the problem of aligning a video that captures a local portion of an environment to the 2D LiDAR scan of the entire environment. We introduce a method (VioLA) that starts w…
GG-LLM: Geometrically Grounding Large Language Models for Zero-shot Human Activity Forecasting in Human-Aware Task Planning
Moritz A. Graule, Volkan Isler
A robot in a human-centric environment needs to account for the human's intent and future motion in its task and motion planning to ensure safe and effective operation. This requir…
Pouring by Feel: An Analysis of Tactile and Proprioceptive Sensing for Accurate Pouring
Pedro Piacenza, Daewon Lee, Volkan Isler
As service robots begin to be deployed to assist humans, it is important for them to be able to perform a skill as ubiquitous as pouring. Specifically, we focus on the task of pour…
VFAS-Grasp: Closed Loop Grasping with Visual Feedback and Adaptive Sampling
Pedro Piacenza, Jiacheng Yuan, Jinwook Huh +1
We consider the problem of closed-loop robotic grasping and present a novel planner which uses Visual Feedback and an uncertainty-aware Adaptive Sampling strategy (VFAS) to close t…
HIO-SDF: Hierarchical Incremental Online Signed Distance Fields
Vasileios Vasilopoulos, Suveer Garg, Jinwook Huh +2
A good representation of a large, complex mobile robot workspace must be space-efficient yet capable of encoding relevant geometric details. When exploring unknown environments, it…
HandNeRF: Learning to Reconstruct Hand-Object Interaction Scene from a Single RGB Image
Hongsuk Choi, Nikhil Chavan-Dafle, Jiacheng Yuan +2
This paper presents a method to learn hand-object interaction prior for reconstructing a 3D hand-object scene from a single RGB image. The inference as well as training-data genera…
System Identification and Control of Front-Steered Ackermann Vehicles through Differentiable Physics
Burak M. Gonultas, Pratik Mukherjee, O. Goktug Poyrazoglu +1
In this paper, we address the problem of system identification and control of a front-steered vehicle which abides by the Ackermann geometry constraints. This problem arises natura…
Onboard View Planning of a Flying Camera for High Fidelity 3D Reconstruction of a Moving Actor
Qingyuan Jiang, Volkan Isler
Capturing and reconstructing a human actor's motion is important for filmmaking and gaming. Currently, motion capture systems with static cameras are used for pixel-level high-fide…
RIC: Rotate-Inpaint-Complete for Generalizable Scene Reconstruction
Isaac Kasahara, Shubham Agrawal, Selim Engin +3
General scene reconstruction refers to the task of estimating the full 3D geometry and texture of a scene containing previously unseen objects. In many practical applications such…
Real-time Simultaneous Multi-Object 3D Shape Reconstruction, 6DoF Pose Estimation and Dense Grasp Prediction
Shubham Agrawal, Nikhil Chavan-Dafle, Isaac Kasahara +3
Robotic manipulation systems operating in complex environments rely on perception systems that provide information about the geometry (pose and 3D shape) of the objects in the scen…
RAMP: Hierarchical Reactive Motion Planning for Manipulation Tasks Using Implicit Signed Distance Functions
Vasileios Vasilopoulos, Suveer Garg, Pedro Piacenza +2
We introduce Reactive Action and Motion Planner (RAMP), which combines the strengths of sampling-based and reactive approaches for motion planning. In essence, RAMP is a hierarchic…
EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks
Ziyun Wang, Fernando Cladera Ojeda, Anthony Bisulco +6
Event-based sensors have recently drawn increasing interest in robotic perception due to their lower latency, higher dynamic range, and lower bandwidth requirements compared to sta…
Pick2Place: Task-aware 6DoF Grasp Estimation via Object-Centric Perspective Affordance
Zhanpeng He, Nikhil Chavan-Dafle, Jinwook Huh +2
The choice of a grasp plays a critical role in the success of downstream manipulation tasks. Consider a task of placing an object in a cluttered scene; the majority of possible gra…
Active Mass Distribution Estimation from Tactile Feedback
Jiacheng Yuan, Changhyun Choi, Ellad B. Tadmor +1
In this work, we present a method to estimate the mass distribution of a rigid object through robotic interactions and tactile feedback. This is a challenging problem because of th…
3D Surface Reconstruction in the Wild by Deforming Shape Priors from Synthetic Data
Nicolai Häni, Jun-Jee Chao, Volkan Isler
Reconstructing the underlying 3D surface of an object from a single image is a challenging problem that has received extensive attention from the computer vision community. Many le…
Neural Optimal Control using Learned System Dynamics
Selim Engin, Volkan Isler
We study the problem of generating control laws for systems with unknown dynamics. Our approach is to represent the controller and the value function with neural networks, and to t…