64 citations · 74 across the 6 of their papers we have counts for
6 papers
Measuring Agents in Production
Melissa Z. Pan, Negar Arabzadeh, Riccardo Cogo +22
LLM-based agents already operate in production across many industries, yet we lack an understanding of what technical methods make deployments successful. We present the first syst…
Using Span Queries to Optimize for Cache and Attention Locality
Paul Castro, Nick Mitchell, Nathan Ordonez +3
Clients are evolving beyond chat completion, and now include a variety of innovative inference-time scaling and deep reasoning techniques. At the same time, inference servers remai…
Hybrid Serverless Computing: Opportunities and Challenges
Paul Castro, Vatche Isahagian, Vinod Muthusamy +1
In recent years, there has been a surge in the adoption of serverless computing due to the ease of deployment, attractive pay-per-use pricing, and transparent horizontal auto-scali…
Reliable Actors with Retry Orchestration
Olivier Tardieu, David Grove, Gheorghe-Teodor Bercea +3
Cloud developers have to build applications that are resilient to failures and interruptions. We advocate for a fault-tolerant programming model for the cloud based on actors, retr…
The server is dead, long live the server: Rise of Serverless Computing, Overview of Current State and Future Trends in Research and Industry
Paul Castro, Vatche Ishakian, Vinod Muthusamy +1
Serverless computing -- an emerging cloud-native paradigm for the deployment of applications and services -- represents an evolution in cloud application development, programming m…
Serverless Computing: Current Trends and Open Problems
Ioana Baldini, Paul Castro, Kerry Chang +8
Serverless computing has emerged as a new compelling paradigm for the deployment of applications and services. It represents an evolution of cloud programming models, abstractions,…