Successful but Unsafe: An Analytical Benchmark for Revealing Collisions in Vision-and-Language Navigation

Hieu D. Pham, Quoc-An Luong, Dung D. Le

Vision-and-language navigation (VLN) agents are typically evaluated by whether they reach a target and how efficiently they follow an instructed route, yet these metrics provide li…