2 papers
cs.DC2025
LOG.io: Unified Rollback Recovery and Data Lineage Capture for Distributed Data Pipelines
Eric Simon, Renato B. Hoffmann, Lucas Alf +1
This paper introduces LOG.io, a comprehensive solution designed for correct rollback recovery and fine-grain data lineage capture in distributed data pipelines. It is tailored for…
cs.AI2025
Automated Planning for Optimal Data Pipeline Instantiation
Leonardo Rosa Amado, Adriano Vogel, Dalvan Griebler +3
Data pipeline frameworks provide abstractions for implementing sequences of data-intensive transformation operators, automating the deployment and execution of such transformations…