Good Memory Has ECC: Evaluating the Memory of Vision-Language Models Beyond Accuracy

Shmuel Berman, Jia Deng

Memory is widely viewed as an important unsolved problem for LLMs and VLMs, and current benchmarks typically evaluate it by testing accuracy over long text or video. However, accur…