AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes

Anja Gruenheid, Jesús Camacho-Rodríguez, Carlo Curino +7

The proliferation of small files in data lakes poses significant challenges, including degraded query performance, increased storage costs, and scalability bottlenecks in distribut…