activity
20242026
most citedQ*: Improving Multi-step Reasoning for LLMs with Deliberative Planning

9 citations · 9 across the 6 of their papers we have counts for

collaborators

9 papers

cs.CL2026

Uncertainty-Aware Budget Allocation for Efficient LLM Tree Search

Jianguo Huang, Zhiyi Lyu, Fuxiang Zhang +3

Tree search enhances multi-step reasoning in large language models (LLMs), yet prevailing methods expand every step with a fixed budget, irrespective of the marginal utility of exp…

cs.AI2026

Finding the Right Fit: Model-Harness Interactions across Agent Tasks

Yixuan Li, Yiyun Zhou, Yao Long Teng +6

Choosing an agent system means choosing both a language model and the harness through which it acts. We ask whether a strong model, harness, or pairing stays strong when the settin…

cs.AI2026

AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectories

Zhiyi Lyu, Yewen Li, Longtao Zheng +7

LLM-based agents are increasingly deployed in real-world applications through tool-use APIs, yet training them for specific environments remains fundamentally difficult: real-world…

cs.CL2026

Two-Stage Reinforcement Learning for Sound and Adversarial Test Generation in Code LLMs

Jiacheng Xu, Wentao Zhang, Zhiyi Lyu +4

Reinforcement learning (RL) has substantially advanced code generation with large language models (LLMs) through executable feedback. The feedback for coding problems mainly comes…

cs.LG2026

PlatformBid: An Auto-Bidding Benchmark from a Unified Advertising Platform's Perspective

Shengtian Yang, Yewen Li, Peng Jiang +4

Real-time bidding is central to computational advertising, comprising three elements: Supply Side Platform (SSP) selling ad impressions, Demand Side Platform (DSP) bidding for adve…

cs.CL2026

LBM: Hierarchical Large Auto-Bidding Model via Reasoning and Acting

Yewen Li, Zhiyi Lyu, Peng Jiang +3

The growing scale of ad auctions on online advertising platforms has intensified competition, making manual bidding impractical and necessitating auto-bidding to help advertisers a…

cs.CL2025

Let's Revise Step-by-Step: A Unified Local Search Framework for Code Generation with LLMs

Zhiyi Lyu, Jianguo Huang, Yanchen Deng +2

Large Language Models (LLMs) with inference-time scaling techniques show promise for code generation, yet face notable efficiency and scalability challenges. Construction-based tre…

cs.LG2025

Towards Efficient Online Tuning of VLM Agents via Counterfactual Soft Reinforcement Learning

Lang Feng, Weihao Tan, Zhiyi Lyu +5

Online fine-tuning vision-language model (VLM) agents with reinforcement learning (RL) has shown promise for equipping agents with multi-step, goal-oriented capabilities in dynamic…

cs.AI2024★ 9 cited

Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planning

Chaojie Wang, Yanchen Deng, Zhiyi Lyu +4

Large Language Models (LLMs) have demonstrated impressive capability in many natural language tasks. However, the auto-regressive generation process makes LLMs prone to produce err…