Publications (13)
AnyNav: Visual Neuro-Symbolic Friction Learning for Off-road Navigation
Taimeng Fu, Zitong Zhan, Zhipeng Zhao +7
Off-road navigation is critical for a wide range of field robotics applications from planetary exploration to disaster response. However, it remains a longstanding challenge due to…
Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy
Chen Wang, Kaiyi Ji, Junyi Geng +16
Data-driven methods such as reinforcement and imitation learning have achieved remarkable success in robot autonomy. However, their data-centric nature still hinders them from gene…
Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints
Qiwei Du, Zitong Zhan, Shaoshu Su +7
Task planning often suffers from severe efficiency bottlenecks when robots must reason over long-horizon action sequences under complex logical constraints, including object afford…
Learning When to Jump for Off-road Navigation
Zhipeng Zhao, Taimeng Fu, Shaoshu Su +5
Low speed does not always guarantee safety in off-road driving. For instance, crossing a ditch may be risky at a low speed due to the risk of getting stuck, yet safe at a higher sp…
PhysORD: A Neuro-Symbolic Approach for Physics-infused Motion Prediction in Off-road Driving
Zhipeng Zhao, Bowen Li, Yi Du +2
Motion prediction is critical for autonomous off-road driving, however, it presents significantly more challenges than on-road driving because of the complex interaction between th…
Fast Task Planning with Neuro-Symbolic Relaxation
Qiwei Du, Bowen Li, Yi Du +5
Real-world task planning requires long-horizon reasoning over large sets of objects with complex relationships and attributes, leading to a combinatorial explosion for classical sy…
Targetless Extrinsic Calibration of Stereo Cameras, Thermal Cameras, and Laser Sensors in the Wild
Taimeng Fu, Huai Yu, Wen Yang +2
The fusion of multi-modal sensors has become increasingly popular in autonomous driving and intelligent robots since it can provide richer information than any single sensor, enhan…
PyPose: A Library for Robot Learning with Physics-based Optimization
Chen Wang, Dasong Gao, Kuan Xu +34
Deep learning has had remarkable success in robotic perception, but its data-centric nature suffers when it comes to generalizing to ever-changing environments. By contrast, physic…
iSLAM: Imperative SLAM
Taimeng Fu, Shaoshu Su, Yiren Lu +1
Simultaneous Localization and Mapping (SLAM) stands as one of the critical challenges in robot navigation. A SLAM system often consists of a front-end component for motion estimati…
VL-Nav: Neuro-Symbolic Reasoning-based Vision-Language Navigation
Yi Du, Taimeng Fu, Zhipeng Zhao +6
Navigating unseen, large-scale environments based on complex and abstract human instructions remains a formidable challenge for autonomous mobile robots. Addressing this requires r…
PyPose v0.6: The Imperative Programming Interface for Robotics
Zitong Zhan, Xiangfu Li, Qihang Li +33
PyPose is an open-source library for robot learning. It combines a learning-based approach with physics-based optimization, which enables seamless end-to-end robot learning. It has…
iWalker: Imperative Visual Planning for Walking Humanoid Robot
Xiao Lin, Yuhao Huang, Taimeng Fu +2
Humanoid robots, designed to operate in human-centric environments, serve as a fundamental platform for a broad range of tasks. Although humanoid robots have been extensively studi…
Vision-Language Memory for Spatial Reasoning
Zuntao Liu, Yi Du, Taimeng Fu +3
Spatial reasoning is a critical capability for intelligent robots, yet current vision-language models (VLMs) still fall short of human-level performance in video-based spatial reas…