3 citations · 7 across the 11 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
AutoScale: Scale-Aware Data Mixing for Pre-Training LLMs
Feiyang Kang, Yifan Sun, Bingbing Wen +4
Domain reweighting is an emerging research area aimed at adjusting the relative weights of different data sources to improve the effectiveness and efficiency of LLM pre-training. W…
cs.CL2024
FASTTRACK: Fast and Accurate Fact Tracing for LLMs
Si Chen, Feiyang Kang, Ning Yu +1
Fact tracing seeks to identify specific training examples that serve as the knowledge source for a given query. Existing approaches to fact tracing rely on assessing the similarity…