A Pre-trained Data Deduplication Model based on Active Learning

Haochen Shi, Xinyao Liu, Fengmao Lv +4

In the era of big data, the issue of data quality has become increasingly prominent. One of the main challenges is the problem of duplicate data, which can arise from repeated entr…