23 citations · 34 across the 16 of their papers we have counts for
16 papers · 1 filter
Token Latency Fairness: Performance Isolation for Multi-Tenant LLM Serving
Dev Bali, Soujanya Ponnapalli, Yichuan Wang +3
LLM serving is typically offered as a shared, multi-tenant service, where high-demand workloads from one client can cause latency SLO violations for others. Existing solutions for…
Sintr: Safe Interactive Transactions in the Presence of Byzantine Clients
Austin T. Li, Daniel H. Lee, Lorenzo Alvisi +2
Byzantine fault-tolerant (BFT) systems are, in principle, an appealing foundation for transactional applications involving mutually distrustful participants. Yet their adoption has…
Optimality and Trade-offs in Fast BFT SMR (Extended Version)
Neil Giridharan, Minh Tung Nguyen, Ittai Abraham +3
Fast state-machine replication (SMR) protocols in the crash-fault setting have attracted significant interest in both academia and industry. This interest stems from their advantag…
Ambulance: saving BFT through racing
Neil Giridharan, Shubham Mishra, Lorenzo Alvisi +5
Today's practical Byzantine Fault Tolerant (BFT) state machine replication deployments are vulnerable to slowdowns. The main culprit is timeouts. Aggressive timeouts spuriously tri…
Real Life Is Uncertain. Consensus Should Be Too!
Reginald Frank, Soujanya Ponnapalli, Octavio Lomeli +3
Modern distributed systems rely on consensus protocols to build a fault-tolerant-core upon which they can build applications. Consensus protocols are correct under a specific failu…
Pirateship: Append-Only Ledgers for (Mostly) Trusted Execution Environments
Shubham Mishra, João Gonçalves, Chawinphat Tankuranand +4
Distributed ledgers are increasingly relied upon by industry to provide trustworthy accountability, strong integrity protection, and high availability for critical data without cen…