Data filtering methods for training language models

Egor Shevchenko, Elena Bruches

Data quality is a critical factor in the effectiveness of machine learning models. Label errors, present even in widely used benchmarks, introduce noise into training data and redu…