From the 1 of 12 linked papers with an AI index.
12 papers
Towards Spatial Supersensing in the Wild
Tianjun Gu, Tianyu Xin, Kuan Zhang +12
The paper introduces VSI‑Super‑Wild, a large benchmark of real‑world long videos with human‑verified QA pairs to evaluate how well multimodal models can track and reason about agen…
MIRAGE: Online LLM Simulation for Microservice Dependency Testing
XinRan Zhang
Existing approaches to microservice dependency simulation--record-replay, pattern-mining, and specification-driven stubs--generate static artifacts before test execution. These art…
Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiverse
Kuan Zhang, Dongchen Liu, Qiyue Zhao +12
The real world unfolds along a single set of physics laws, yet human intelligence demonstrates a remarkable capacity to generalize experiences from this singular physical existence…
Distributed Generative Inference of LLM at Internet Scales with Multi-Dimensional Communication Optimization
Jiu Chen, Shuangyan Yang, Xu Xiong +4
Decentralized LLM inference distributes computation among heterogeneous nodes across the internet, offering a performant and cost-efficient solution, alternative to traditional cen…
How Sensitive Are Safety Benchmarks to Judge Configuration Choices?
Xinran Zhang
Safety benchmarks such as HarmBench rely on LLM judges to classify model responses as harmful or safe, yet the judge configuration, namely the combination of judge model and judge…
Rethinking Atomic Decomposition for LLM Judges: A Prompt-Controlled Study of Reference-Grounded QA Evaluation
Xinran Zhang
Atomic decomposition -- breaking a candidate answer into claims before verifying each against a reference -- is a widely adopted design for LLM-based reference-grounded judges. How…