Donkii: Can Annotation Error Detection Methods Find Errors in Instruction-Tuning Datasets?

Leon Weber-Genzel, Robert Litschko, Ekaterina Artemova +1

Instruction tuning has become an integral part of training pipelines for Large Language Models (LLMs) and has been shown to yield strong performance gains. In an orthogonal line of…