8 papers
Reinforcement Learning for Flow-Matching Policies with Density Transport
Boshu Lei, Kostas Daniilidis, Antonio Loquercio
We present an online reinforcement learning (RL) algorithm for fine-tuning flow-matching policies in continuous-control problems. Our key insight is to view RL-based policy improve…
ActiveGrasp: Information-Guided Active Grasping with Calibrated Energy-based Model
Boshu Lei, Wen Jiang, Kostas Daniilidis
Grasping in a densely cluttered environment is a challenging task for robots. Previous methods tried to solve this problem by actively gathering multiple views before grasp pose ge…
Active Next-Best-View Optimization for Risk-Averse Path Planning
Amirhossein Mollaei Khass, Guangyi Liu, Vivek Pandey +4
Safe navigation in uncertain environments requires planning methods that integrate risk aversion with active perception. In this work, we present a unified framework that refines a…
Multimodal LLM Guided Exploration and Active Mapping using Fisher Information
Wen Jiang, Boshu Lei, Katrina Ashton +1
We present an active mapping system that plans for both long-horizon exploration goals and short-term actions using a 3D Gaussian Splatting (3DGS) representation. Existing methods…
TensorTouch: Calibration of Tactile Sensors for High Resolution Stress Tensor and Deformation for Dexterous Manipulation
Won Kyung Do, Matthew Strong, Aiden Swann +2
Advanced dexterous manipulation involving multiple simultaneous contacts across different surfaces, like pinching coins from ground or manipulating intertwined objects, remains cha…
Next Best Sense: Guiding Vision and Touch with FisherRF for 3D Gaussian Splatting
Matthew Strong, Boshu Lei, Aiden Swann +3
We propose a framework for active next best view and touch selection for robotic manipulators using 3D Gaussian Splatting (3DGS). 3DGS is emerging as a useful explicit 3D scene rep…