24 citations · 83 across the 32 of their papers we have counts for
9 papers · 1 filter
Not Your Usual Type(s): Data contracts as types across languages and engines
Aldrin Montana, Colin Marc, Luca Bigon +1
Composable data systems promise to let developers combine languages, engines, and catalogs without sacrificing a coherent user experience. In practice, however, pipeline-node bound…
GitLake: Git-for-data for the agentic lakehouse
Weiming Sheng, Jinlang Wang, Manuel Barros +3
We present GitLake, a Git-for-data design for an agent-first lakehouse. The system lifts single-table Iceberg snapshots into lakehouse-wide commits, branches, and merges, letting a…
Querying Everything Everywhere All at Once: Supervaluationism for the Agentic Lakehouse
Jacopo Tagliabue
Agentic analytics is turning the lakehouse into a multi-version system: swarms of (human or AI) producers materialize competing pipelines in data branches, while (human or AI) cons…
Test-Time Optimization of Physical Query Plans with LLMs
Mehmet Hamza Erol, Xiangpeng Hao, Federico Bianchi +3
Traditional query optimization relies on cost-based optimizers that estimate execution cost (e.g., runtime, memory, and I/O) using predefined heuristics and statistical models. Imp…
Eudoxia: a FaaS scheduling simulator for the composable lakehouse
Tapan Srivastava, Jacopo Tagliabue, Ciro Greco
Due to the variety of its target use cases and the large API surface area to cover, a data lakehouse (DLH) is a natural candidate for a composable data system. Bauplan is a composa…
FaaS and Furious: abstractions and differential caching for efficient data pre-processing
Jacopo Tagliabue, Ryan Curtin, Ciro Greco
Data pre-processing pipelines are the bread and butter of any successful AI project. We introduce a novel programming model for pipelines in a data lakehouse, allowing users to int…
Bauplan: zero-copy, scale-up FaaS for data pipelines
Jacopo Tagliabue, Tyler Caraza-Harter, Ciro Greco
Chaining functions for longer workloads is a key use case for FaaS platforms in data applications. However, modern data pipelines differ significantly from typical serverless use c…
Reproducible data science over data lakes: replayable data pipelines with Bauplan and Nessie
Jacopo Tagliabue, Ciro Greco
As the Lakehouse architecture becomes more widespread, ensuring the reproducibility of data workloads over data lakes emerges as a crucial concern for data engineers. However, achi…
Building a serverless Data Lakehouse from spare parts
Jacopo Tagliabue, Ciro Greco, Luca Bigon
The recently proposed Data Lakehouse architecture is built on open file formats, performance, and first-class support for data transformation, BI and data science: while the vision…