FaaS and Furious: abstractions and differential caching for efficient data pre-processing

Jacopo Tagliabue, Ryan Curtin, Ciro Greco

Data pre-processing pipelines are the bread and butter of any successful AI project. We introduce a novel programming model for pipelines in a data lakehouse, allowing users to int…