232 citations · 302 across the 7 of their papers we have counts for
9 papers
Leveraging Cloud Computing to Make Autonomous Vehicles Safer
Peter Schafhalter, Sukrit Kalra, Le Xu +2
The safety of autonomous vehicles (AVs) depends on their ability to perform complex computations on high-volume sensor data in a timely manner. Their ability to run these computati…
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
Ying Sheng, Lianmin Zheng, Binhang Yuan +11
The high computational and memory requirements of large language model (LLM) inference make it feasible only with multiple high-end accelerators. Motivated by the emerging demand f…
Kernel-as-a-Service: A Serverless Interface to GPUs
Nathan Pemberton, Anton Zabreyko, Zhoujie Ding +2
Serverless computing has made it easier than ever to deploy applications over scalable cloud resources, all the while driving higher utilization for cloud providers. While this tec…
Skyplane: Optimizing Transfer Cost and Throughput Using Cloud-Aware Overlays
Paras Jain, Sam Kumar, Sarah Wooders +3
Cloud applications are increasingly distributing data across multiple regions and cloud providers. Unfortunately, wide-area bulk data transfers are often slow, bottlenecking applic…
The Sky Above The Clouds
Sarah Chasins, Alvin Cheung, Natacha Crooks +14
Technology ecosystems often undergo significant transformations as they mature. For example, telephony, the Internet, and PCs all started with a single provider, but in the United…
Optimizing Prediction Serving on Low-Latency Serverless Dataflow
Vikram Sreekanti, Harikaran Subbaraj, Chenggang Wu +2
Prediction serving systems are designed to provide large volumes of low-latency inferences machine learning models. These systems mix data processing and computationally intensive…
A Fault-Tolerance Shim for Serverless Computing
Vikram Sreekanti, Chenggang Wu, Saurav Chhatrapati +3
Serverless computing has grown in popularity in recent years, with an increasing number of applications being built on Functions-as-a-Service (FaaS) platforms. By default, FaaS pla…
Cloud Programming Simplified: A Berkeley View on Serverless Computing
Eric Jonas, Johann Schleier-Smith, Vikram Sreekanti +11
Serverless cloud computing handles virtually all the system administration operations needed to make it easier for programmers to use the cloud. It provides an interface that great…
Serverless Computing: One Step Forward, Two Steps Back
Joseph M. Hellerstein, Jose Faleiro, Joseph E. Gonzalez +4
Serverless computing offers the potential to program the cloud in an autoscaling, pay-as-you go manner. In this paper we address critical gaps in first-generation serverless comput…