7 citations · 14 across the 33 of their papers we have counts for
34 papers
Two-Stage Multi-modal Learning for Dynamic Audio-Visual Navigation: From Physical Alignment to Scene Aggregation
Jia Li, Yinfeng Yu
Embodied Audio-Visual Navigation (AVN) requires an agent to locate sound targets by jointly leveraging visual and auditory cues. While prior work has achieved notable success with…
A Hybrid Mamba for Audio-Visual Navigation
Yi Wang, Yinfeng Yu
Since the paradigm centered on convolutional neural networks and recurrent architectures was established in 2020, the fundamental backbone networks for audio-visual navigation have…
HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Models
Luyuan Jia, Yinfeng Yu
Zero-shot object-goal navigation aims to enable an intelligent agent to explore and navigate to objects of unknown categories in an unfamiliar environment without specific target t…
Generalizable Audio-Visual Navigation via Binaural Difference Attention and Action Transition Prediction
Jia Li, Yinfeng Yu
In Audio-Visual Navigation (AVN), agents must locate sound sources in unseen 3D environments using visual and auditory cues. However, existing methods often struggle with generaliz…
Agentic-MME: What Agentic Capability Really Brings to Multimodal Intelligence?
Qianshan Wei, Yishan Yang, Siyi Wang +12
Multimodal Large Language Models (MLLMs) are evolving from passive observers into active agents, solving problems through Visual Expansion (invoking visual tools) and Knowledge Exp…
Reliability-Aware Geometric Fusion for Robust Audio-Visual Navigation
Teng Liu, Yinfeng Yu
Audio-Visual Navigation (AVN) requires an embodied agent to navigate toward a sound source by utilizing both vision and binaural audio. A core challenge arises in complex acoustic…
Spatial-Aware Conditioned Fusion for Audio-Visual Navigation
Shaohang Wu, Yinfeng Yu
Audio-visual navigation tasks require agents to locate and navigate toward continuously vocalizing targets using only visual observations and acoustic cues. However, existing metho…
Audio Spatially-Guided Fusion for Audio-Visual Navigation
Xinyu Zhou, Yinfeng Yu
Audio-visual Navigation refers to an agent utilizing visual and auditory information in complex 3D environments to accomplish target localization and path planning, thereby achievi…
Residual Cross-Modal Fusion Networks for Audio-Visual Navigation
Yi Wang, Yinfeng Yu, Bin Ren
Audio-visual embodied navigation aims to enable an agent to autonomously localize and reach a sound source in unseen 3D environments by leveraging auditory cues. The key challenge…
Audio-Guided Visual Perception for Audio-Visual Navigation
Yi Wang, Yinfeng Yu, Fuchun Sun +2
Audio-Visual Embodied Navigation aims to enable agents to autonomously navigate to sound sources in unknown 3D environments using auditory cues. While current AVN methods excel on…
ECTSpeech: Enhancing Efficient Speech Synthesis via Easy Consistency Tuning
Tao Zhu, Yinfeng Yu, Liejun Wang +2
Diffusion models have demonstrated remarkable performance in speech synthesis, but typically require multi-step sampling, resulting in low inference efficiency. Recent studies addr…
EGSTalker: Real-Time Audio-Driven Talking Head Generation with Efficient Gaussian Deformation
Tianheng Zhu, Yinfeng Yu, Liejun Wang +2
This paper presents EGSTalker, a real-time audio-driven talking head generation framework based on 3D Gaussian Splatting (3DGS). Designed to enhance both speed and visual fidelity,…
Landmark-Guided Knowledge for Vision-and-Language Navigation
Dongsheng Yang, Meiling Zhu, Yinfeng Yu
Vision-and-language navigation is one of the core tasks in embodied intelligence, requiring an agent to autonomously navigate in an unfamiliar environment based on natural language…
Iterative Residual Cross-Attention Mechanism: An Integrated Approach for Audio-Visual Navigation Tasks
Hailong Zhang, Yinfeng Yu, Liejun Wang +2
Audio-visual navigation represents a significant area of research in which intelligent agents utilize egocentric visual and auditory perceptions to identify audio targets. Conventi…
FSDENet: A Frequency and Spatial Domains based Detail Enhancement Network for Remote Sensing Semantic Segmentation
Jiahao Fu, Yinfeng Yu, Liejun Wang
To fully leverage spatial information for remote sensing image segmentation and address semantic edge ambiguities caused by grayscale variations (e.g., shadows and low-contrast reg…
Dynamic Multi-Target Fusion for Efficient Audio-Visual Navigation
Yinfeng Yu, Hailong Zhang, Meiling Zhu
Audiovisual embodied navigation enables robots to locate audio sources by dynamically integrating visual observations from onboard sensors with the auditory signals emitted by the…
Advancing Audio-Visual Navigation Through Multi-Agent Collaboration in 3D Environments
Hailong Zhang, Yinfeng Yu, Liejun Wang +2
Intelligent agents often require collaborative strategies to achieve complex tasks beyond individual capabilities in real-world scenarios. While existing audio-visual navigation (A…
Audio-Guided Dynamic Modality Fusion with Stereo-Aware Attention for Audio-Visual Navigation
Jia Li, Yinfeng Yu, Liejun Wang +2
In audio-visual navigation (AVN) tasks, an embodied agent must autonomously localize a sound source in unknown and complex 3D environments based on audio-visual signals. Existing m…
PGSTalker: Real-Time Audio-Driven Talking Head Generation via 3D Gaussian Splatting with Pixel-Aware Density Control
Tianheng Zhu, Yinfeng Yu, Liejun Wang +2
Audio-driven talking head generation is crucial for applications in virtual reality, digital avatars, and film production. While NeRF-based methods enable high-fidelity reconstruct…
DOPE: Dual Object Perception-Enhancement Network for Vision-and-Language Navigation
Yinfeng Yu, Dongsheng Yang
Vision-and-Language Navigation (VLN) is a challenging task where an agent must understand language instructions and navigate unfamiliar environments using visual cues. The agent mu…
DGFNet: End-to-End Audio-Visual Source Separation Based on Dynamic Gating Fusion
Yinfeng Yu, Shiyu Sun
Current Audio-Visual Source Separation methods primarily adopt two design strategies. The first strategy involves fusing audio and visual features at the bottleneck layer of the en…
AMNet: An Acoustic Model Network for Enhanced Mandarin Speech Synthesis
Yubing Cao, Yinfeng Yu, Yongming Li +1
This paper presents AMNet, an Acoustic Model Network designed to improve the performance of Mandarin speech synthesis by incorporating phrase structure annotation and local convolu…
Leveraging Label Potential for Enhanced Multimodal Emotion Recognition
Xuechun Shao, Yinfeng Yu, Liejun Wang
Multimodal emotion recognition (MER) seeks to integrate various modalities to predict emotional states accurately. However, most current research focuses solely on the fusion of au…
Magnitude-Phase Dual-Path Speech Enhancement Network based on Self-Supervised Embedding and Perceptual Contrast Stretch Boosting
Alimjan Mattursun, Liejun Wang, Yinfeng Yu +1
Speech self-supervised learning (SSL) has made great progress in various speech processing tasks, but there is still room for improvement in speech enhancement (SE). This paper pre…