7 papers
Scaling with Confidence: Calibrating Confidence of LLMs for Adaptive Test Time Scaling
Xuqing Yang, Yi Yuan, Shanzhe Lei +1
Training large language models (LLMs) with reinforcement learning (RL) has significantly advanced their performance on reasoning and question-answering tasks. However, prevailing R…
From Coarse to Fine: Benchmarking and Reward Modeling for Writing-Centric Generation Tasks
Qingyu Ren, Tianjun Pan, Xingzhou Chen +1
Large language models have achieved remarkable progress in text generation but still struggle with generative writing tasks. In terms of evaluation, existing benchmarks evaluate wr…
Deliberative Searcher: Improving LLM Reliability via Reinforcement Learning with constraints
Zhenyun Yin, Shujie Wang, Xuhong Wang +2
Improving the reliability of large language models (LLMs) is critical for deploying them in real-world scenarios. In this paper, we propose \textbf{Deliberative Searcher}, the firs…
Towards Trustworthy Report Generation: A Deep Research Agent with Progressive Confidence Estimation and Calibration
Yi Yuan, Xuhong Wang, Shanzhe Lei
As agent-based systems continue to evolve, deep research agents are capable of automatically generating research-style reports across diverse domains. While these agents promise to…
SciDataCopilot: An Agentic Data Preparation Framework for AGI-driven Scientific Discovery
Jiyong Rao, Yicheng Qiu, Jiahui Zhang +29
The current landscape of AI for Science (AI4S) is predominantly anchored in large-scale textual corpora, where generative AI systems excel at hypothesis generation, literature sear…
TestAgent: Automatic Benchmarking and Exploratory Interaction for Evaluating LLMs in Vertical Domains
Wanying Wang, Zeyu Ma, Xuhong Wang +3
As Large Language Models (LLMs) are increasingly deployed in highly specialized vertical domains, the evaluation of their domain-specific performance becomes critical. However, exi…