6 papers
From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery
Jiaqi Wei, Yuejin Yang, Xiang Zhang +24
Artificial intelligence (AI) is reshaping scientific discovery, evolving from specialized computational tools into autonomous research partners. We position Agentic Science as a pi…
Unifying Tree Search Algorithm and Reward Design for LLM Reasoning: A Survey
Jiaqi Wei, Xiang Zhang, Yuejin Yang +10
Deliberative tree search is a cornerstone of modern Large Language Model (LLM) research, driving the pivot from brute-force scaling toward algorithmic efficiency. This single parad…
Why Prompt Design Matters and Works: A Complexity Analysis of Prompt Search Space in LLMs
Xiang Zhang, Juntai Cao, Jiaqi Wei +2
Despite the remarkable successes of large language models (LLMs), the underlying Transformer architecture has inherent limitations in handling complex reasoning tasks. Chain-of-tho…
Tokenization Constraints in LLMs: A Study of Symbolic and Arithmetic Reasoning Limits
Xiang Zhang, Juntai Cao, Jiaqi Wei +2
Tokenization is the first - and often underappreciated - layer of computation in language models. While Chain-of-Thought (CoT) prompting enables transformer models to approximate r…
Multi2: Multi-Agent Test-Time Scalable Framework for Multi-Document Processing
Juntai Cao, Xiang Zhang, Raymond Li +4
Recent advances in test-time scaling have shown promising results in improving Large Language Model (LLM) performance through strategic computation allocation during inference. Whi…
Counting Ability of Large Language Models and Impact of Tokenization
Xiang Zhang, Juntai Cao, Chenyu You
Transformers, the backbone of modern large language models (LLMs), face inherent architectural limitations that impede their reasoning capabilities. Unlike recurrent networks, Tran…