8 citations · 9 across the 12 of their papers we have counts for
5 papers · 1 filter
Hierarchical Data Selection via Manifold Coverage and Sparse Feature Coverage in LLM Post-training
Peng Sun, Yi Yang, Antong Zhang +7
As supervised fine-tuning data continues to scale, selecting high-value subsets from large candidate pools is crucial for reducing training cost and improving model performance. Ex…
Data-DPO: Direct Preference Optimization for Target Model Data Selection in LLM Post-Training
Peng Sun, Yi Yang, Antong Zhang +7
Data selection in supervised fine-tuning aims to select a small set of effective samples from large-scale candidate data, reducing training cost while preserving model performance.…
Reachability Is Not Realization: Tracing the Sources of LLM Benchmark Gains
Yanchao Li, Wanhao Liu, Jiaqing Xie +4
Benchmark gains are often treated as evidence of greater LLM capability. Yet the same gain can reflect different changes in model behavior. A model may reach new answers, or produc…
Guardian-as-an-Advisor: Advancing Next-Generation Guardian Models for Trustworthy LLMs
Yue Huang, Haomin Zhuang, Jiayi Ye +6
Hard-gated safety checkers often over-refuse and misalign with a vendor's model spec; prevailing taxonomies also neglect robustness and honesty, yielding safer-on-paper yet less us…
Does the Question Really Matter? Training-Free Data Selection for Vision-Language SFT
Peng Sun, Yi Yang, Huawen Shen +4
Visual instruction tuning is crucial for improving vision-language large models (VLLMs). However, many samples can be solved via linguistic patterns or common-sense shortcuts, with…