SemHash-LLM: A Multi-Granularity Semantic Hashing Framework for Document Deduplication

Xinyi Fang, Kejian Tong, Jiabei Liu +2

Large scale document deduplication must preserve semantic equivalence while remaining efficient over massive corpora. We present SemHash LLM, a multi granularity framework that uni…