5 papers · 1 filter
LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing
Hao Li, Yiqun Zhang, Zhaoyan Guo +9
Large language model (LLM) routing assigns each query to the most suitable model from an ensemble. We introduce LLMRouterBench, a large-scale benchmark and unified framework for LL…
EWE: An Agentic Framework for Extreme Weather Analysis
Zhe Jiang, Jiong Wang, Xiaoyu Yue +5
Extreme weather events pose escalating risks to global society, underscoring the urgent need to unravel their underlying physical mechanisms. Yet the prevailing expert-driven, labo…
Learning Compact Representations of LLM Abilities via Item Response Theory
Jianhao Chen, Chenxu Wang, Gengrui Zhang +5
Recent years have witnessed a surge in the number of large language models (LLMs), yet efficiently managing and utilizing these vast resources remains a significant challenge. In t…
PhysicsMinions: Winning Gold Medals in the Latest Physics Olympiads with a Coevolutionary Multimodal Multi-Agent System
Fangchen Yu, Junchi Yao, Ziyi Wang +10
Physics is central to understanding and shaping the real world, and the ability to solve physics problems is a key indicator of real-world physical intelligence. Physics Olympiads,…
SCI-Verifier: Scientific Verifier with Thinking
Shenghe Zheng, Chenyu Huang, Fangchen Yu +8
As large language models (LLMs) are increasingly applied to scientific reasoning, the complexity of answer formats and the diversity of equivalent expressions make answer verificat…