5 papers
NavHarness: Adaptive Goals for Agentic Vision-Language Navigation
Haoxiang Shi, Zaijing Li, Muhe Ding +3
Vision-Language Navigation (VLN) requires embodied agents to generate actions based on instructions and observations. General-purpose multimodal agents offer a promising basis for…
From Where to How: Continuous 4D Interaction Forecasting from Egocentric Video
Qiaohui Chu, Haoyu Zhang, Meng Liu +3
Egocentric 4D interaction forecasting aims to anticipate both where future interactions will occur in 3D and how the human body will move to realize them, providing an important ca…
Beyond Waypoints: A Trajectory-Centric Waypointing Paradigm for Vision-Language Navigation
Haoxiang Shi, Xiang Deng, Haoyu Zhang +3
Vision-Language Navigation in Continuous Environments (VLN-CE) requires agents to follow natural-language instructions while navigating in real-world-like environments. Most VLN-CE…
DAgger Diffusion Navigation: DAgger Boosted Diffusion Policy for Vision-Language Navigation
Haoxiang Shi, Xiang Deng, Zaijing Li +3
Vision-Language Navigation in Continuous Environments (VLN-CE) requires agents to follow natural language instructions through free-form 3D spaces. Existing VLN-CE approaches typic…
Intention-Guided Cognitive Reasoning for Egocentric Long-Term Action Anticipation
Qiaohui Chu, Haoyu Zhang, Meng Liu +3
Long-term action anticipation from egocentric video is critical for applications such as human-computer interaction and assistive technologies, where anticipating user intent enabl…