From the 1 of 24 linked papers with an AI index.
24 papers
A Hybrid Mamba for Audio-Visual Navigation
Yi Wang, Yinfeng Yu
The paper introduces Samba, a hybrid Mamba-based model for audio‑visual navigation that replaces GRUs with a Mamba State Encoder and adds an Audio Mamba Encoder to better capture g…
HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Models
Luyuan Jia, Yinfeng Yu
Zero-shot object-goal navigation aims to enable an intelligent agent to explore and navigate to objects of unknown categories in an unfamiliar environment without specific target t…
Generalizable Audio-Visual Navigation via Binaural Difference Attention and Action Transition Prediction
Jia Li, Yinfeng Yu
In Audio-Visual Navigation (AVN), agents must locate sound sources in unseen 3D environments using visual and auditory cues. However, existing methods often struggle with generaliz…
Agentic-MME: What Agentic Capability Really Brings to Multimodal Intelligence?
Qianshan Wei, Yishan Yang, Siyi Wang +12
Multimodal Large Language Models (MLLMs) are evolving from passive observers into active agents, solving problems through Visual Expansion (invoking visual tools) and Knowledge Exp…
Reliability-Aware Geometric Fusion for Robust Audio-Visual Navigation
Teng Liu, Yinfeng Yu
Audio-Visual Navigation (AVN) requires an embodied agent to navigate toward a sound source by utilizing both vision and binaural audio. A core challenge arises in complex acoustic…
Spatial-Aware Conditioned Fusion for Audio-Visual Navigation
Shaohang Wu, Yinfeng Yu
Audio-visual navigation tasks require agents to locate and navigate toward continuously vocalizing targets using only visual observations and acoustic cues. However, existing metho…