7 papers
TRIM: Token-wise Attention-Derived Saliency for Data-Efficient Instruction Tuning
Manish Nagaraj, Sakshi Choudhary, Utkarsh Saxena +2
Instruction tuning is essential for aligning large language models (LLMs) to downstream tasks and commonly relies on large, diverse corpora. However, small, high-quality subsets, k…
Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
Praditha Alwis, Soumyadeep Chandra, Deepak Ravikumar +1
High-quality video datasets are foundational for training robust models in tasks like action recognition, phase detection, and event segmentation. However, many real-world video da…
GradientSpace: Unsupervised Data Clustering for Improved Instruction Tuning
Shrihari Sridharan, Deepak Ravikumar, Anand Raghunathan +1
Instruction tuning is one of the key steps required for adapting large language models (LLMs) to a broad spectrum of downstream applications. However, this procedure is difficult b…
Coresets from Trajectories: Selecting Data via Correlation of Loss Differences
Manish Nagaraj, Deepak Ravikumar, Kaushik Roy
Deep learning models achieve state-of-the-art performance across domains but face scalability challenges in real-time or resource-constrained scenarios. To address this, we propose…
The Easy Path to Robustness: Coreset Selection using Sample Hardness
Pranav Ramesh, Arjun Roy, Deepak Ravikumar +2
Designing adversarially robust models from a data-centric perspective requires understanding which input samples are most crucial for learning resilient features. While coreset sel…
Finding the Muses: Identifying Coresets through Loss Trajectories
Manish Nagaraj, Deepak Ravikumar, Efstathia Soufleri +1
Deep learning models achieve state-of-the-art performance across domains but face scalability challenges in real-time or resource-constrained scenarios. To address this, we propose…