7 papers
Verifier-Grounded Agentic RL for Provably Correct Code
George Ma, Yuhao Zhang, Bing He +5
Reinforcement learning for code usually rewards passing tests, which a model can do while remaining wrong on the inputs the tests do not cover. A program verifier instead decides w…
Revisiting the 16x Pretraining Compute Gap between Diffusion and Autoregressive Language Models
Guanghan Wang, Bing He, Zhan Shi +3
Diffusion language models (DLMs) have attracted wide attention for their fast, parallel decoding, but they are believed to be far less efficient to train than autoregressive langua…
Evo-Harness: Context-to-Harness Skill Compilation for Self-Evolving Agents
Tianxin Wei, Zhan Shi, Minhua Lin +14
Learning from experience is critical for developing capable, self-improving large language model (LLM) agents. Existing methods typically extract knowledge from accumulated traject…
Position: Agentic Evolution is the Path to Evolving LLMs
Minhua Lin, Hanqing Lu, Zhan Shi +11
As Large Language Models (LLMs) move from curated training sets into open-ended real-world environments, a fundamental limitation emerges: static training cannot keep pace with con…
TRAJECT-Bench:A Trajectory-Aware Benchmark for Evaluating Agentic Tool Use
Pengfei He, Zhenwei Dai, Bing He +10
Large language model (LLM)-based agents increasingly rely on tool use to complete real-world tasks. While existing works evaluate the LLMs' tool use capability, they largely focus…
Adaptive Test-Time Reasoning via Reward-Guided Dual-Phase Search
Yingqian Cui, Zhenwei Dai, Pengfei He +8
Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and u…
Hierarchical Query Classification in E-commerce Search
Bing He, Sreyashi Nag, Limeng Cui +5
E-commerce platforms typically store and structure product information and search data in a hierarchy. Efficiently categorizing user search queries into a similar hierarchical stru…