1 citations · 1 across the 8 of their papers we have counts for
4 papers · 1 filter
dattri-LLM: A Unified and Efficient Library for Training Data Attribution at LLM Scale
Shixuan Liu, Tongli Zhou, Junwei Deng +2
Training data attribution (TDA) estimates the contribution of individual training examples to model outputs. Most scalable TDA methods rely on per-example gradients, whose computat…
How Faithful Is Trajectory-Based Data Attribution? Error Sources, Remedies, and Practical Guidelines
Junwei Deng, Pingbang Hu, Suliang Jin +4
Trajectory-based data attribution methods estimate the influence of training samples on model predictions by unrolling the training trajectory. They are widely used in applications…
Dr. Post-Training: A Data Regularization Perspective on LLM Post-Training
Pingbang Hu, Xueshen Liu, Z. Morley Mao +1
Data selection methods address a critical challenge in LLM post-training: effectively leveraging scarce, high-fidelity target data alongside abundant but imperfectly aligned genera…
A Unified Theory of Random Projection for Influence Functions
Pingbang Hu, Yuzheng Hu, Jiaqi W. Ma +1
Influence functions and related data attribution scores take the form of , where is a curvature operator. In modern overparametrized models,…