Data-Prep-Kit: getting your data ready for LLM application development

David Wood, Boris Lublinsky, Alexy Roytman +21

Data preparation is the first and a very important step towards any Large Language Model (LLM) development. This paper introduces an easy-to-use, extensible, and scale-flexible ope…