4 citations · 21 across the 25 of their papers we have counts for
26 papers
Generalizable Hierarchical Skill Learning via Object-Centric Representation
Haibo Zhao, Yu Qi, Boce Hu +9
We present Generalizable Hierarchical Skill Learning (GSL), a novel framework for hierarchical policy learning that significantly improves policy generalization and sample efficien…
Dissecting Embodied Abilities in Multimodal Language Models through Skill-level Evaluation and Diagnosis
Yu Qi, Haibo Zhao, Ziyu Guo +17
Understanding the capability bottlenecks of embodied multimodal large language models (MLLMs) is crucial for improving embodied agents. However, existing embodied benchmarks mainly…
Clebsch-Gordan Transformer: Fast and Global Equivariant Attention
Owen Lewis Howell, Linfeng Zhao, Xupeng Zhu +6
The global attention mechanism is one of the keys to the success of transformer architecture, but it incurs quadratic computational costs in relation to the number of tokens. On th…
SE(3)-Equivariant Diffusion Policy in Spherical Fourier Space
Xupeng Zhu, Fan Wang, Robin Walters +1
Diffusion Policies are effective at learning closed-loop manipulation policies from human demonstrations but generalize poorly to novel arrangements of objects in 3D space, hurting…
EquAct: An SE(3)-Equivariant Multi-Task Transformer for Open-Loop Robotic Manipulation
Xupeng Zhu, Yu Qi, Yizhe Zhu +2
Transformer architectures can effectively learn language-conditioned, multi-task 3D open-loop manipulation policies from demonstrations by jointly processing natural language instr…
3D Equivariant Visuomotor Policy Learning via Spherical Projection
Boce Hu, Dian Wang, David Klee +5
Equivariant models have recently been shown to improve the data efficiency of diffusion policy by a significant margin. However, prior work that explored this direction focused pri…
Push-Grasp Policy Learning Using Equivariant Models and Grasp Score Optimization
Boce Hu, Heng Tian, Dian Wang +4
Goal-conditioned robotic grasping in cluttered environments remains a challenging problem due to occlusions caused by surrounding objects, which prevent direct access to the target…
Hierarchical Equivariant Policy via Frame Transfer
Haibo Zhao, Dian Wang, Yizhe Zhu +6
Recent advances in hierarchical policy learning highlight the advantages of decomposing systems into high-level and low-level agents, enabling efficient long-horizon reasoning and…
Coarse-to-Fine 3D Keyframe Transporter
Xupeng Zhu, David Klee, Dian Wang +5
Recent advances in Keyframe Imitation Learning (IL) have enabled learning-based agents to solve a diverse range of manipulation tasks. However, most approaches ignore the rich symm…
Equivariant Action Sampling for Reinforcement Learning and Planning
Linfeng Zhao, Owen Howell, Xupeng Zhu +4
Reinforcement learning (RL) algorithms for continuous control tasks require accurate sampling-based action selection. Many tasks, such as robotic manipulation, contain inherent pro…
ThinkGrasp: A Vision-Language System for Strategic Part Grasping in Clutter
Yaoyao Qian, Xupeng Zhu, Ondrej Biza +5
Robotic grasping in cluttered environments remains a significant challenge due to occlusions and complex object arrangements. We have developed ThinkGrasp, a plug-and-play vision-l…
OrbitGrasp: -Equivariant Grasp Learning
Boce Hu, Xupeng Zhu, Dian Wang +5
While grasp detection is an important part of any robotic manipulation pipeline, reliable and accurate grasp detection in remains a research challenge. Many robotics applic…
Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3D
Haojie Huang, Owen Howell, Dian Wang +3
Many complex robotic manipulation tasks can be decomposed as a sequence of pick and place actions. Training a robotic agent to learn this sequence over many different starting cond…
Can Euclidean Symmetry be Leveraged in Reinforcement Learning and Planning?
Linfeng Zhao, Owen Howell, Jung Yeon Park +3
In robotic tasks, changes in reference frames typically do not influence the underlying physical properties of the system, which has been known as invariance of physical laws.These…
On Robot Grasp Learning Using Equivariant Models
Xupeng Zhu, Dian Wang, Guanang Su +3
Real-world grasp detection is challenging due to the stochasticity in grasp dynamics and the noise in hardware. Ideally, the system would adapt to the real world by training direct…
A Hierarchical Hybrid Learning Framework for Multi-agent Trajectory Prediction
Yujun Jiao, Mingze Miao, Zhishuai Yin +4
Accurate and robust trajectory prediction of neighboring agents is critical for autonomous vehicles traversing in complex scenes. Most methods proposed in recent years are deep lea…
A General Theory of Correct, Incorrect, and Extrinsic Equivariance
Dian Wang, Xupeng Zhu, Jung Yeon Park +4
Although equivariant machine learning has proven effective at many tasks, success depends heavily on the assumption that the ground truth function is symmetric over the entire doma…
SEIL: Simulation-augmented Equivariant Imitation Learning
Mingxi Jia, Dian Wang, Guanang Su +4
In robotic manipulation, acquiring samples is extremely expensive because it often requires interacting with the real world. Traditional image-level data augmentation has shown the…
Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detection
Haojie Huang, Dian Wang, Xupeng Zhu +2
Given point cloud input, the problem of 6-DoF grasp pose detection is to identify a set of hand poses in SE(3) from which an object can be successfully grasped. This important prob…
Integrating Symmetry into Differentiable Planning with Steerable Convolutions
Linfeng Zhao, Xupeng Zhu, Lingzhi Kong +2
We study how group symmetry helps improve data efficiency and generalization for end-to-end differentiable planning algorithms when symmetry appears in decision-making tasks. Motiv…
BulletArm: An Open-Source Robotic Manipulation Benchmark and Learning Framework
Dian Wang, Colin Kohler, Xupeng Zhu +2
We present BulletArm, a novel benchmark and learning-environment for robotic manipulation. BulletArm is designed around two key principles: reproducibility and extensibility. We ai…
On-Robot Learning With Equivariant Models
Dian Wang, Mingxi Jia, Xupeng Zhu +2
Recently, equivariant neural network models have been shown to improve sample efficiency for tasks in computer vision and reinforcement learning. This paper explores this idea in t…
Sample Efficient Grasp Learning Using Equivariant Models
Xupeng Zhu, Dian Wang, Ondrej Biza +3
In planar grasp detection, the goal is to learn a function from an image of a scene onto a set of feasible grasp poses in . In this paper, we recognize that the opt…
Equivariant Learning in Spatial Action Spaces
Dian Wang, Robin Walters, Xupeng Zhu +1
Recently, a variety of new equivariant neural network model architectures have been proposed that generalize better over rotational and reflectional symmetries than standard models…