Can Vision-Language Models Solve the Shell Game?

Tiedong Liu, Wee Sun Lee

Visual entity tracking is an innate cognitive ability in humans, yet it remains a critical bottleneck for Vision-Language Models (VLMs). This deficit is often obscured in existing…