103 citations · 200 across the 68 of their papers we have counts for
39 papers · 1 filter
HetroD: A High-Fidelity Drone Dataset and Benchmark for Autonomous Driving in Heterogeneous Traffic
Yu-Hsiang Chen, Wei-Jer Chang, Christian Kotulla +7
We present HetroD, a dataset and benchmark for developing autonomous driving systems in heterogeneous environments. HetroD targets the critical challenge of navi- gating real-world…
Fractional-order Modeling for Nonlinear Soft Actuators via Particle Swarm Optimization
Wu-Te Yang, Masayoshi Tomizuka
Modeling soft pneumatic actuators with high precision remains a fundamental challenge due to their highly nonlinear and compliant characteristics. This paper proposes an innovative…
VER: Vision Expert Transformer for Robot Learning via Foundation Distillation and Dynamic Routing
Yixiao Wang, Mingxiao Huo, Zhixuan Liang +8
Pretrained vision foundation models (VFMs) advance robotic learning via rich visual representations, yet individual VFMs typically excel only in specific domains, limiting generali…
DEXOP: A Device for Robotic Transfer of Dexterous Human Manipulation
Hao-Shu Fang, Branden Romero, Yichen Xie +9
We introduce perioperation, a paradigm for robotic data collection that sensorizes and records human manipulation while maximizing the transferability of the data to real robots. W…
Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructions
Cunxin Fan, Xiaosong Jia, Yihang Sun +8
The rise of foundation models paves the way for generalist robot policies in the physical world. Existing methods relying on text-only instructions often struggle to generalize to…
REMAC: Self-Reflective and Self-Evolving Multi-Agent Collaboration for Long-Horizon Robot Manipulation
Puzhen Yuan, Angyuan Ma, Yunchao Yao +3
Vision-language models (VLMs) have demonstrated remarkable capabilities in robotic planning, particularly for long-horizon tasks that require a holistic understanding of the enviro…
Physics-Aware Robotic Palletization with Online Masking Inference
Tianqi Zhang, Zheng Wu, Yuxin Chen +6
The efficient planning of stacking boxes, especially in the online setting where the sequence of item arrivals is unpredictable, remains a critical challenge in modern warehouse an…
DexHandDiff: Interaction-aware Diffusion Planning for Adaptive Dexterous Manipulation
Zhixuan Liang, Yao Mu, Yixiao Wang +6
Dexterous manipulation with contact-rich interactions is crucial for advanced robotics. While recent diffusion-based planning approaches show promise for simple manipulation tasks,…
Language-Driven Policy Distillation for Cooperative Driving in Multi-Agent Reinforcement Learning
Jiaqi Liu, Chengkai Xu, Peng Hang +4
The cooperative driving technology of Connected and Autonomous Vehicles (CAVs) is crucial for improving the efficiency and safety of transportation systems. Learning-based methods,…
Embodiment-Agnostic Action Planning via Object-Part Scene Flow
Weiliang Tang, Jia-Hui Pan, Wei Zhan +6
Observing that the key for robotic action planning is to understand the target-object motion when its associated part is manipulated by the end effector, we propose to generate the…
P2 Explore: Efficient Exploration in Unknown Cluttered Environment with Floor Plan Prediction
Kun Song, Gaoming Chen, Masayoshi Tomizuka +3
Robot exploration aims at the reconstruction of unknown environments, and it is important to achieve it with shorter paths. Traditional methods focus on optimizing the visiting ord…
WOMD-Reasoning: A Large-Scale Dataset for Interaction Reasoning in Driving
Yiheng Li, Cunxin Fan, Chongjian Ge +9
Language models uncover unprecedented abilities in analyzing driving scenarios, owing to their limitless knowledge accumulated from text-based pre-training. Naturally, they should…
Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learning
Yixiao Wang, Yifei Zhang, Mingxiao Huo +8
The increasing complexity of tasks in robotics demands efficient strategies for multitask and continual learning. Traditional models typically rely on a universal policy for all ta…
Residual-MPPI: Online Policy Customization for Continuous Control
Pengcheng Wang, Chenran Li, Catherine Weaver +4
Policies developed through Reinforcement Learning (RL) and Imitation Learning (IL) have shown great potential in continuous control tasks, but real-world applications often require…
MEReQ: Max-Ent Residual-Q Inverse RL for Sample-Efficient Alignment from Intervention
Yuxin Chen, Chen Tang, Jianglan Wei +6
Aligning robot behavior with human preferences is crucial for deploying embodied AI agents in human-centered environments. A promising solution is interactive imitation learning fr…
Underactuated Control of Multiple Soft Pneumatic Actuators via Stable Inversion
Wu-Te Yang, Burak Kurkcu, Masayoshi Tomizuka
Soft grippers, with their inherent compliance and adaptability, show advantages for delicate and versatile manipulation tasks in robotics. This paper presents a novel approach to u…
NeRFs in Robotics: A Survey
Guangming Wang, Lei Pan, Songyou Peng +7
Detailed and realistic 3D environment representations have been a long-standing goal in the fields of computer vision and robotics. The recent emergence of neural implicit represen…
MATRIX: Multi-Agent Trajectory Generation with Diverse Contexts
Zhuo Xu, Rui Zhou, Yida Yin +3
Data-driven methods have great advantages in modeling complicated human behavioral dynamics and dealing with many human-robot interaction applications. However, collecting massive…
DrPlanner: Diagnosis and Repair of Motion Planners for Automated Vehicles Using Large Language Models
Yuanfei Lin, Chenran Li, Mingyu Ding +3
Motion planners are essential for the safe operation of automated vehicles across various scenarios. However, no motion planning algorithm has achieved perfection in the literature…
PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Models
Dingkun Guo, Yuqi Xiang, Shuqi Zhao +4
Robotic grasping is a fundamental aspect of robot functionality, defining how robots interact with objects. Despite substantial progress, its generalizability to counter-intuitive…
Contact-Implicit Model Predictive Control for Dexterous In-hand Manipulation: A Long-Horizon and Robust Approach
Yongpeng Jiang, Mingrui Yu, Xinghao Zhu +2
Dexterous in-hand manipulation is an essential skill of production and life. However, the highly stiff and mutable nature of contacts limits real-time contact detection and inferen…
Learning Online Belief Prediction for Efficient POMDP Planning in Autonomous Driving
Zhiyu Huang, Chen Tang, Chen Lv +2
Effective decision-making in autonomous driving relies on accurate inference of other traffic agents' future behaviors. To achieve this, we propose an online belief-update-based be…
SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries
Wei-Jer Chang, Francesco Pittaluga, Masayoshi Tomizuka +2
Evaluating the performance of autonomous vehicle planning algorithms necessitates simulating long-tail safety-critical traffic scenarios. However, traditional methods for generatin…
Multi-level Reasoning for Robotic Assembly: From Sequence Inference to Contact Selection
Xinghao Zhu, Devesh K. Jha, Diego Romeres +3
Automating the assembly of objects from their parts is a complex problem with innumerable applications in manufacturing, maintenance, and recycling. Unlike existing research, which…