Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
FOLD: Fuzzy Online Deduplication for Very Large Evolving Datasets via Approximate Nearest Neighbor Search
Nelson Bore, Pritish Mishra, Constantin Adam +2
Fuzzy deduplication is key to constructing large language model training corpora. However, classic Locality-Sensitive Hashing (LSH) pipelines scale poorly as corpora grow and are i…
cs.DC2024
Towards Reconfigurable Linearizable Reads
Myles Thiessen, Aleksey Panas, Guy Khazma +1
Linearizable datastores are desirable because they provide users with the illusion that the datastore is run on a single machine that performs client operations one at a time. To r…