Reliability-Aware Determinantal Point Processes for Robust Informative Data Selection in Large Language Models

Ahmad Sarlak, Abolfazl Razi

Informative data selection is a key requirement for large language models (LLMs) to minimize the amount of data required for fine-tuning, network distillation, and token pruning, e…