23 citations · 49 across the 25 of their papers we have counts for
27 papers
Token Latency Fairness: Performance Isolation for Multi-Tenant LLM Serving
Dev Bali, Soujanya Ponnapalli, Yichuan Wang +3
LLM serving is typically offered as a shared, multi-tenant service, where high-demand workloads from one client can cause latency SLO violations for others. Existing solutions for…
Sintr: Safe Interactive Transactions in the Presence of Byzantine Clients
Austin T. Li, Daniel H. Lee, Lorenzo Alvisi +2
Byzantine fault-tolerant (BFT) systems are, in principle, an appealing foundation for transactional applications involving mutually distrustful participants. Yet their adoption has…
Optimality and Trade-offs in Fast BFT SMR (Extended Version)
Neil Giridharan, Minh Tung Nguyen, Ittai Abraham +3
Fast state-machine replication (SMR) protocols in the crash-fault setting have attracted significant interest in both academia and industry. This interest stems from their advantag…
Ambulance: saving BFT through racing
Neil Giridharan, Shubham Mishra, Lorenzo Alvisi +5
Today's practical Byzantine Fault Tolerant (BFT) state machine replication deployments are vulnerable to slowdowns. The main culprit is timeouts. Aggressive timeouts spuriously tri…
Real Life Is Uncertain. Consensus Should Be Too!
Reginald Frank, Soujanya Ponnapalli, Octavio Lomeli +3
Modern distributed systems rely on consensus protocols to build a fault-tolerant-core upon which they can build applications. Consensus protocols are correct under a specific failu…
Pirateship: Append-Only Ledgers for (Mostly) Trusted Execution Environments
Shubham Mishra, João Gonçalves, Chawinphat Tankuranand +4
Distributed ledgers are increasingly relied upon by industry to provide trustworthy accountability, strong integrity protection, and high availability for critical data without cen…
It's not a lie if you don't get caught: simplifying reconfiguration in SMR through dirty logs
Allen Clement, Natacha Crooks, Neil Giridharan +1
Production state-machine replication (SMR) implementations are complex, multi-layered architectures comprising data dissemination, ordering, execution, and reconfiguration componen…
Delta Fair Sharing: Performance Isolation for Multi-Tenant Storage Systems
Tyler Griggs, Soujanya Ponnapalli, Dev Bali +8
Modern storage systems, often deployed to support multiple tenants in the cloud, must provide performance isolation. Unfortunately, traditional approaches such as fair sharing do n…
Supporting Our AI Overlords: Redesigning Data Systems to be Agent-First
Shu Liu, Soujanya Ponnapalli, Shreya Shankar +12
Large Language Model (LLM) agents, acting on their users' behalf to manipulate and analyze data, are likely to become the dominant workload for data systems in the future. When wor…
Rollbaccine : Herd Immunity against Storage Rollback Attacks in TEEs [Technical Report]
David Chu, Aditya Balasubramanian, Dee Bao +4
Today, users can "lift-and-shift" unmodified applications into modern, VM-based Trusted Execution Environments (TEEs) in order to gain hardware-based security guarantees. However,…
SkyStore: Cost-Optimized Object Storage Across Regions and Clouds
Shu Liu, Xiangxi Mo, Moshik Hershcovitch +11
Modern applications span multiple clouds to reduce costs, avoid vendor lock-in, and leverage low-availability resources in another cloud. However, standard object stores operate wi…
Granular Synchrony
Neil Giridharan, Ittai Abraham, Natacha Crooks +2
Today's mainstream network timing models for distributed computing are synchrony, partial synchrony, and asynchrony. These models are coarse-grained and often make either too stron…
Smart Casual Verification of the Confidential Consortium Framework
Heidi Howard, Markus A. Kuppe, Edward Ashton +2
The Confidential Consortium Framework (CCF) is an open-source platform for developing trustworthy and reliable cloud applications. CCF powers Microsoft's Azure Confidential Ledger…
Optimizing Distributed Protocols with Query Rewrites [Technical Report]
David Chu, Rithvik Panchapakesan, Shadaj Laddad +6
Distributed protocols such as 2PC and Paxos lie at the core of many systems in the cloud, but standard implementations do not scale. New scalable distributed protocols are develope…
Autobahn: Seamless high speed BFT
Neil Giridharan, Florian Suri-Payer, Ittai Abraham +2
Today's practical, high performance Byzantine Fault Tolerant (BFT) consensus protocols operate in the partial synchrony model. However, existing protocols are inefficient when depl…
Picsou: Enabling Replicated State Machines to Communicate Efficiently
Reginald Frank, Micah Murray, Chawinphat Tankuranand +5
Replicated state machines (RSMs) cannot communicate effectively today as there is no formal framework or efficient protocol to do so. To address this issue, we introduce a new prim…
Optimizing the cloud? Don't train models. Build oracles!
Tiemo Bang, Conor Power, Siavash Ameli +2
We propose cloud oracles, an alternative to machine learning for online optimization of cloud configurations. Our cloud oracle approach guarantees complete accuracy and explainabil…
Reflections on trusting distributed trust
Emma Dauterman, Vivian Fang, Natacha Crooks +1
Many systems today distribute trust across multiple parties such that the system provides certain security properties if a subset of the parties are honest. In the past few years,…
Keep CALM and CRDT On
Shadaj Laddad, Conor Power, Mae Milano +3
Despite decades of research and practical experience, developers have few tools for programming reliable distributed applications without resorting to expensive coordination techni…
rgpdOS: GDPR Enforcement By The Operating System
Alain Tchana, Raphael Colin, Adrien Le Berre +4
The General Data Protection Regulation (GDPR) forces IT companies to comply with a number of principles when dealing with European citizens' personal data. Non-compliant companies…
The Sky Above The Clouds
Sarah Chasins, Alvin Cheung, Natacha Crooks +14
Technology ecosystems often undergo significant transformations as they mature. For example, telephony, the Internet, and PCs all started with a single provider, but in the United…
BeeGees: stayin' alive in chained BFT
Ittai Abraham, Natacha Crooks, Neil Giridharan +2
Modern chained Byzantine Fault Tolerant (BFT) systems leverage a combination of pipelining and leader rotation to obtain both efficiency and fairness. These protocols, however, req…
Dissecting BFT Consensus: In Trusted Components we Trust!
Suyash Gupta, Sajjad Rahnama, Shubham Pandey +2
The growing interest in reliable multi-party applications has fostered widespread adoption of Byzantine Fault-Tolerant (BFT) consensus protocols. Existing BFT protocols need f more…
Basil: Breaking up BFT with ACID (transactions)
Florian Suri-Payer, Matthew Burke, Zheng Wang +3
This paper presents Basil, the first transactional, leaderless Byzantine Fault Tolerant key-value store. Basil leverages ACID transactions to scalably implement the abstraction of…