3 citations · 7 across the 9 of their papers we have counts for
9 papers
SPARTUN3D: Situated Spatial Understanding of 3D World in Large Language Models
Yue Zhang, Zhiyang Xu, Ying Shen +2
Integrating the 3D world into large language models (3D-based LLMs) has been a promising research direction for 3D scene understanding. However, current 3D-based LLMs fall short in…
Narrowing the Gap between Vision and Action in Navigation
Yue Zhang, Parisa Kordjamshidi
The existing methods for Vision and Language Navigation in the Continuous Environment (VLN-CE) commonly incorporate a waypoint predictor to discretize the environment. This simplif…
Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Models
Yue Zhang, Ziqiao Ma, Jialu Li +6
Vision-and-Language Navigation (VLN) has gained increasing attention over recent years and many approaches have emerged to advance their development. The remarkable achievements of…
NavHint: Vision and Language Navigation Agent with a Hint Generator
Yue Zhang, Quan Guo, Parisa Kordjamshidi
Existing work on vision and language navigation mainly relies on navigation-related losses to establish the connection between vision and language modalities, neglecting aspects of…
Common Sense Reasoning for Deepfake Detection
Yue Zhang, Ben Colman, Xiao Guo +2
State-of-the-art deepfake detection approaches rely on image-based features extracted via neural networks. While these approaches trained in a supervised manner extract likely fake…
VLN-Trans: Translator for the Vision and Language Navigation Agent
Yue Zhang, Parisa Kordjamshidi
Language understanding is essential for the navigation agent to follow instructions. We observe two kinds of issues in the instructions that can make the navigation task challengin…
GLUECons: A Generic Benchmark for Learning Under Constraints
Hossein Rajaby Faghihi, Aliakbar Nafar, Chen Zheng +7
Recent research has shown that integrating domain knowledge into deep learning architectures is effective -- it helps reduce the amount of required data, improves the accuracy of t…
LOViS: Learning Orientation and Visual Signals for Vision and Language Navigation
Yue Zhang, Parisa Kordjamshidi
Understanding spatial and visual information is essential for a navigation agent who follows natural language instructions. The current Transformer-based VLN agents entangle the or…
Towards Navigation by Reasoning over Spatial Configurations
Yue Zhang, Quan Guo, Parisa Kordjamshidi
We deal with the navigation problem where the agent follows natural language instructions while observing the environment. Focusing on language understanding, we show the importanc…