2 papers
cs.DB2026
Zero-Scan Data Quality: Leveraging Table Format Metadata for Continuous Observability at Scale
Mohit Verma, Shantanu Rawat, Christian Bush +3
Modern table formats such as Apache Iceberg compute and store metadata-commit timestamps, record counts, and column-level statistics such as null counts and value bounds at write t…
cs.DB2025
AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes
Anja Gruenheid, Jesús Camacho-RodrÃguez, Carlo Curino +7
The proliferation of small files in data lakes poses significant challenges, including degraded query performance, increased storage costs, and scalability bottlenecks in distribut…