13 papers
OmniNav: Robust Long-Horizon Target Navigation in Dynamic Environments
Yujie Tang, Meiling Wang, Jinhao Jiang +4
Long-horizon target navigation requires a robot to sustain task execution across evolving observations, decisions, and physical interactions. This requires three coupled capabiliti…
PhysReal: Learning Real-World Deformable Object Physics via Hybrid Constitutive Modeling
Yinan Deng, Jianqiao Song, Yisi Zhang +3
Learning physically plausible dynamics from visual observations is essential for interactive world models and embodied agents. However, modeling real-world deformable objects remai…
PaMoSplat: Part-Aware Motion-Guided Gaussian Splatting for Dynamic Scene Reconstruction
Yinan Deng, Jianyu Dou, Jiahui Wang +3
Dynamic scene reconstruction represents a fundamental yet demanding challenge in computer vision and robotics. While recent progress in 3DGS-based methods has advanced dynamic scen…
See Once, Then Act: Vision-Language-Action Model with Task Learning from One-Shot Video Demonstrations
Guangyan Chen, Meiling Wang, Qi Shao +10
Developing robust and general-purpose manipulation policies represents a fundamental objective in robotics research. While Vision-Language-Action (VLA) models have demonstrated pro…
OmniMap: A General Mapping Framework Integrating Optics, Geometry, and Semantics
Yinan Deng, Yufeng Yue, Jianyu Dou +5
Robotic systems demand accurate and comprehensive 3D environment perception, requiring simultaneous capture of photo-realistic appearance (optical), precise layout shape (geometric…
OpenMulti: Open-Vocabulary Instance-Level Multi-Agent Distributed Implicit Mapping
Jianyu Dou, Yinan Deng, Jiahui Wang +3
Multi-agent distributed collaborative mapping provides comprehensive and efficient representations for robots. However, existing approaches lack instance-level awareness and semant…
OpenVox: Real-time Instance-level Open-vocabulary Probabilistic Voxel Representation
Yinan Deng, Bicheng Yao, Yihang Tang +2
In recent years, vision-language models (VLMs) have advanced open-vocabulary mapping, enabling mobile robots to simultaneously achieve environmental reconstruction and high-level s…
OpenIN: Open-Vocabulary Instance-Oriented Navigation in Dynamic Domestic Environments
Yujie Tang, Meiling Wang, Yinan Deng +3
In daily domestic settings, frequently used objects like cups often have unfixed positions and multiple instances within the same category, and their carriers frequently change as…
LCP-Fusion: A Neural Implicit SLAM with Enhanced Local Constraints and Computable Prior
Jiahui Wang, Yinan Deng, Yi Yang +1
Recently the dense Simultaneous Localization and Mapping (SLAM) based on neural implicit representation has shown impressive progress in hole filling and high-fidelity mapping. Nev…
OpenObject-NAV: Open-Vocabulary Object-Oriented Navigation Based on Dynamic Carrier-Relationship Scene Graph
Yujie Tang, Meiling Wang, Yinan Deng +3
In everyday life, frequently used objects like cups often have unfixed positions and multiple instances within the same category, and their carriers frequently change as well. As a…
OpenObj: Open-Vocabulary Object-Level Neural Radiance Fields with Fine-Grained Understanding
Yinan Deng, Jiahui Wang, Jingyu Zhao +3
In recent years, there has been a surge of interest in open-vocabulary 3D scene reconstruction facilitated by visual language models (VLMs), which showcase remarkable capabilities…
LGSDF: Continual Global Learning of Signed Distance Fields Aided by Local Updating
Yufeng Yue, Yinan Deng, Jiahui Wang +1
Implicit reconstruction of ESDF (Euclidean Signed Distance Field) involves training a neural network to regress the signed distance from any point to the nearest obstacle, which ha…
OpenGraph: Open-Vocabulary Hierarchical 3D Graph Representation in Large-Scale Outdoor Environments
Yinan Deng, Jiahui Wang, Jingyu Zhao +4
Environment representations endowed with sophisticated semantics are pivotal for facilitating seamless interaction between robots and humans, enabling them to effectively carry out…