4 papers
Agent Journey Beyond RGB: Hierarchical Semantic-Spatial Representation Enrichment for Vision-and-Language Navigation
Xuesong Zhang, Yunbo Xu, Jia Li +2
Navigating unseen environments from natural language instructions remains challenging for egocentric agents in Vision-and-Language Navigation (VLN). Humans naturally ground concret…
Disentangling Foreground and Background for vision-Language Navigation via Online Augmentation
Yunbo Xu, Xuesong Zhang, Jia Li +2
Following language instructions, vision-language navigation (VLN) agents are tasked with navigating unseen environments. While augmenting multifaceted visual representations has pr…
Seeing is Believing? Enhancing Vision-Language Navigation using Visual Perturbations
Xuesong Zhang, Jia Li, Yunbo Xu +2
Autonomous navigation guided by natural language instructions in embodied environments remains a challenge for vision-language navigation (VLN) agents. Although recent advancements…
DAT: Dialogue-Aware Transformer with Modality-Group Fusion for Human Engagement Estimation
Jia Li, Yangchen Yu, Yin Chen +6
Engagement estimation plays a crucial role in understanding human social behaviors, attracting increasing research interests in fields such as affective computing and human-compute…