4 papers · 1 filter
TopoPrune: Robust Data Pruning via Unified Latent Space Topology
Arjun Roy, Prajna G. Malettira, Manish Nagaraj +1
Geometric data pruning methods, while practical for leveraging pretrained models, are fundamentally unstable. Their reliance on extrinsic geometry renders them highly sensitive to…
TraceNAS: Zero-shot LLM Pruning via Gradient Trace Correlation
Prajna G. Malettira, Manish Nagaraj, Arjun Roy +2
Structured pruning is essential for efficient deployment of Large Language Models (LLMs). The varying sensitivity of LLM sub-blocks to pruning necessitates the identification of op…
Coresets from Trajectories: Selecting Data via Correlation of Loss Differences
Manish Nagaraj, Deepak Ravikumar, Kaushik Roy
Deep learning models achieve state-of-the-art performance across domains but face scalability challenges in real-time or resource-constrained scenarios. To address this, we propose…
Finding the Muses: Identifying Coresets through Loss Trajectories
Manish Nagaraj, Deepak Ravikumar, Efstathia Soufleri +1
Deep learning models achieve state-of-the-art performance across domains but face scalability challenges in real-time or resource-constrained scenarios. To address this, we propose…