"High-Quality" Data for Early-Stage Instruction Tuning: An Empirical Study of Data Quality Metrics

Vladimir Necula, David Gvadzabia, Sofia Serrano

"Data quality" is widely invoked in instruction tuning, but the term is often underspecified. We study it as an operational property by asking which simple example-level metrics, d…