Linear Mechanisms for Spatiotemporal Reasoning in Vision Language Models

Raphi Kang, Hongqiao Chen, Georgia Gkioxari +1

Spatio-temporal reasoning is a remarkable capability of Vision Language Models (VLMs), but the underlying mechanisms of such abilities remain largely opaque. We postulate that visu…