LSH methods for data deduplication in a Wikipedia artificial dataset

Juan Ciro, Daniel Galvez, Tim Schlippe +1

This paper illustrates locality sensitive hasing (LSH) models for the identification and removal of nearly redundant data in a text dataset. To evaluate the different models, we cr…