4 papers
CARL: Constraint-Aware Reinforcement Learning for Planning with LLMs
Qiuyi Qi, Jinjian Zhang, Mutian Bao +9
Despite their strong reasoning capabilities and extensive world knowledge, Large Language Models (LLMs) frequently generate plans that violate task constraints, undermining their r…
Curriculum Reinforcement Learning Can Incentivize Reasoning Capacity in LLMs Beyond the Base Model
Pengxiang Cai, Tianchen Fang, Xiaohan Li +3
Reinforcement learning with verifiable rewards (RLVR) is widely viewed as a promising path toward continuously improving large language models. Recent works, however, suggest that…
Strengthening LLMs for Tabular Prediction with Structural Priors
Pengxiang Cai, Zihao Gao, Wanchen Lian +2
Tabular prediction has long been dominated by gradient-boosted decision trees and specialized deep tabular models, while large language models (LLMs) remain difficult to make compe…
From Misleading Queries to Accurate Answers: A Three-Stage Fine-Tuning Method for LLMs
Guocong Li, Weize Liu, Yihang Wu +4
Large language models (LLMs) exhibit excellent performance in natural language processing (NLP), but remain highly sensitive to the quality of input queries, especially when these…