5 papers
EvolSQL: Structure-Aware Evolution for Scalable Text-to-SQL Data Synthesis
Xuanguang Pan, Chongyang Tao, Jiayuan Bai +5
Training effective Text-to-SQL models remains challenging due to the scarcity of high-quality, diverse, and structurally complex datasets. Existing methods either rely on limited h…
AIR: Post-training Data Selection for Reasoning via Attention Head Influence
Jinrui Liu, Jeff Wu, Xuanguang Pan +3
LLMs achieve remarkable multi-step reasoning capabilities, yet effectively transferring these skills via post-training distillation remains challenging. Existing data selection met…
Dynamic Stratified Contrastive Learning with Upstream Augmentation for MILP Branching
Tongkai Lu, Shuai Ma, Chongyang Tao
Mixed Integer Linear Programming (MILP) is a fundamental class of NP-hard problems that has garnered significant attention from both academia and industry. The Branch-and-Bound (B\…
JudgeSQL: Reasoning over SQL Candidates with Weighted Consensus Tournament
Jiayuan Bai, Xuan-guang Pan, Chongyang Tao +1
Text-to-SQL is a pivotal task that bridges natural language understanding and structured data access, yet it remains fundamentally challenging due to semantic ambiguity and complex…
LLMs are Also Effective Embedding Models: An In-depth Overview
Chongyang Tao, Tao Shen, Shen Gao +6
Large language models (LLMs) have revolutionized natural language processing by achieving state-of-the-art performance across various tasks. Recently, their effectiveness as embedd…