4 papers · 1 filter
Learning from Synthetic Data without Model Collapse in Iterative Instruction Tuning
Xiaonan Luo, Yue Huang, Kehan Guo +4
Model collapse is a central challenge in learning from synthetic data: as later-generation large language models (LLMs) are trained on an increasing proportion of model-generated d…
Reliable Control-Point Selection for Steering Reasoning in Large Language Models
Haomin Zhuang, Hojun Yoo, Xiaonan Luo +2
Steering vectors offer a training-free mechanism for controlling reasoning behaviors in large language models, but constructing effective vectors requires identifying genuine behav…
Better Datasets Start From RefineLab: Automatic Optimization for High-Quality Dataset Refinement
Xiaonan Luo, Yue Huang, Ping He +1
High-quality Question-Answer (QA) datasets are foundational for reliable Large Language Model (LLM) evaluation, yet even expert-crafted datasets exhibit persistent gaps in domain c…
ChemOrch: Empowering LLMs with Chemical Intelligence via Synthetic Instructions
Yue Huang, Zhengzhe Jiang, Xiaonan Luo +12
Empowering large language models (LLMs) with chemical intelligence remains a challenge due to the scarcity of high-quality, domain-specific instruction-response datasets and the mi…