SLAP: Stratified Loss-based Pruning for On-Policy Data-Efficient Instruction Tuning

Run Zou, Jianhang Ding, Yifan Ding +3

Instruction tuning has optimized the specialized capabilities of large language models (LLMs), but it often requires extensive datasets and prolonged training times. The challenge…