4 papers
ATLAS: All-round Testing of Long-context Abilities across Scales
Deli Huang, Cunguang Wang, Hongyin Tang +15
Long-context language models now advertise context windows up to millions of tokens, yet evaluations typically report a single length or a narrow task family, masking two failure m…
NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Models
Ziyue Zhu, Shangyang Wu, Shuai Zhao +5
Vision-Language-Action (VLA) models are formulated to ground instructions in visual context and generate action sequences for robotic manipulation. Despite recent progress, VLA mod…
EMemBench: Interactive Benchmarking of Episodic Memory for VLM Agents
Xinze Li, Ziyue Zhu, Siyuan Liu +4
We introduce EMemBench, a programmatic benchmark for evaluating long-term memory of agents through interactive games. Rather than using a fixed set of questions, EMemBench generate…
What Do LLM Agents Know About Their World? Task2Quiz: A Paradigm for Studying Environment Understanding
Siyuan Liu, Hongbang Yuan, Xinze Li +3
Large language model (LLM) agents have demonstrated remarkable capabilities in complex decision-making and tool-use tasks, yet their ability to generalize across varying environmen…