3 citations · 4 across the 37 of their papers we have counts for
16 papers · 1 filter
See Once, Then Act: Vision-Language-Action Model with Task Learning from One-Shot Video Demonstrations
Guangyan Chen, Meiling Wang, Qi Shao +10
Developing robust and general-purpose manipulation policies represents a fundamental objective in robotics research. While Vision-Language-Action (VLA) models have demonstrated pro…
GLUE: Global-Local Unified Encoding for Imitation Learning via Key-Patch Tracking
Ye Chen, Zichen Zhou, Jianyu Dou +3
In recent years, visual representation learning has gained widespread attention in robotic imitation learning. However, in complex Out-of-Distribution(OOD) settings characterized b…
OmniMap: A General Mapping Framework Integrating Optics, Geometry, and Semantics
Yinan Deng, Yufeng Yue, Jianyu Dou +5
Robotic systems demand accurate and comprehensive 3D environment perception, requiring simultaneous capture of photo-realistic appearance (optical), precise layout shape (geometric…
OpenMulti: Open-Vocabulary Instance-Level Multi-Agent Distributed Implicit Mapping
Jianyu Dou, Yinan Deng, Jiahui Wang +3
Multi-agent distributed collaborative mapping provides comprehensive and efficient representations for robots. However, existing approaches lack instance-level awareness and semant…
OpenGS-Fusion: Open-Vocabulary Dense Mapping with Hybrid 3D Gaussian Splatting for Refined Object-Level Understanding
Dianyi Yang, Xihan Wang, Yu Gao +4
Recent advancements in 3D scene understanding have made significant strides in enabling interaction with scenes using open-vocabulary queries, particularly for VR/AR and robotic ap…
FMimic: Foundation Models are Fine-grained Action Learners from Human Videos
Guangyan Chen, Meiling Wang, Te Cui +8
Visual imitation learning (VIL) provides an efficient and intuitive strategy for robotic systems to acquire novel skills. Recent advancements in foundation models, particularly Vis…
STEP Planner: Constructing cross-hierarchical subgoal tree as an embodied long-horizon task planner
Tianxing Zhou, Zhirui Wang, Haojia Ao +5
The ability to perform reliable long-horizon task planning is crucial for deploying robots in real-world environments. However, directly employing Large Language Models (LLMs) as a…
TASeg: Text-aware RGB-T Semantic Segmentation based on Fine-tuning Vision Foundation Models
Meng Yu, Te Cui, Qitong Chu +3
Reliable semantic segmentation of open environments is essential for intelligent systems, yet significant problems remain: 1) Existing RGB-T semantic segmentation models mainly rel…
MCOO-SLAM: A Multi-Camera Omnidirectional Object SLAM System
Miaoxin Pan, Jinnan Li, Yaowen Zhang +2
Object-level SLAM offers structured and semantically meaningful environment representations, making it more interpretable and suitable for high-level robotic tasks. However, most e…
DINO-CoDT: Multi-class Collaborative Detection and Tracking with Vision Foundation Models
Xunjie He, Christina Dao Wen Lee, Meiling Wang +4
Collaborative perception plays a crucial role in enhancing environmental understanding by expanding the perceptual range and improving robustness against sensor failures, which pri…
DroneSplat: 3D Gaussian Splatting for Robust 3D Reconstruction from In-the-Wild Drone Imagery
Jiadong Tang, Yu Gao, Dianyi Yang +3
Drones have become essential tools for reconstructing wild scenes due to their outstanding maneuverability. Recent advances in radiance field methods have achieved remarkable rende…
GaussianGraph: 3D Gaussian-based Scene Graph Generation for Open-world Scene Understanding
Xihan Wang, Dianyi Yang, Yu Gao +3
Recent advancements in 3D Gaussian Splatting(3DGS) have significantly improved semantic scene understanding, enabling natural language queries to localize objects within a scene. H…
OpenGS-SLAM: Open-Set Dense Semantic SLAM with 3D Gaussian Splatting for Object-Level Scene Understanding
Dianyi Yang, Yu Gao, Xihan Wang +3
Recent advancements in 3D Gaussian Splatting have significantly improved the efficiency and quality of dense semantic SLAM. However, previous methods are generally constrained by l…
ChatStitch: Visualizing Through Structures via Surround-View Unsupervised Deep Image Stitching with Collaborative LLM-Agents
Hao Liang, Zhipeng Dong, Kaixin Chen +4
Surround-view perception has garnered significant attention for its ability to enhance the perception capabilities of autonomous driving vehicles through the exchange of informatio…
OpenVox: Real-time Instance-level Open-vocabulary Probabilistic Voxel Representation
Yinan Deng, Bicheng Yao, Yihang Tang +2
In recent years, vision-language models (VLMs) have advanced open-vocabulary mapping, enabling mobile robots to simultaneously achieve environmental reconstruction and high-level s…
OpenIN: Open-Vocabulary Instance-Oriented Navigation in Dynamic Domestic Environments
Yujie Tang, Meiling Wang, Yinan Deng +3
In daily domestic settings, frequently used objects like cups often have unfixed positions and multiple instances within the same category, and their carriers frequently change as…