EntroGD: Scalable Generalized Deduplication for Efficient Direct Analytics on Compressed IoT Data

Xiaobo Zhao, Daniel E. Lucani

Massive data streams from IoT and cyber-physical systems must be processed under strict bandwidth, latency, and resource constraints. Generalized Deduplication (GD) is a promising…