3 papers
cs.DC2022
Timestamp tokens: a better coordination primitive for data-processing systems
Andrea Lattuada, Frank McSherry
Distributed data processing systems have advanced through models that expose more and more opportunities for concurrency within a computation. The scheduling of these increasingly…
cs.DC2018
Shared Arrangements: practical inter-query sharing for streaming dataflows
Frank McSherry, Andrea Lattuada, Malte Schwarzkopf +1
Current systems for data-parallel, incremental processing and view maintenance over high-rate streams isolate the execution of independent queries. This creates unwanted redundancy…
cs.DC2018
Megaphone: Latency-conscious state migration for distributed streaming dataflows
Moritz Hoffmann, Andrea Lattuada, Frank McSherry +3
We design and implement Megaphone, a data migration mechanism for stateful distributed dataflow engines with latency objectives. When compared to existing migration mechanisms, Meg…