5 citations · 8 across the 4 of their papers we have counts for
4 papers
Cache-Craft: Managing Chunk-Caches for Efficient Retrieval-Augmented Generation
Shubham Agarwal, Sai Sundaresan, Subrata Mitra +6
Retrieval-Augmented Generation (RAG) is often used with Large Language Models (LLMs) to infuse domain knowledge or user-specific information. In RAG, given a user query, a retrieve…
Approximate Caching for Efficiently Serving Diffusion Models
Shubham Agarwal, Subrata Mitra, Sarthak Chakraborty +3
Text-to-image generation using diffusion models has seen explosive popularity owing to their ability in producing high quality images adhering to text prompts. However, production-…
ESRO: Experience Assisted Service Reliability against Outages
Sarthak Chakraborty, Shubham Agarwal, Shaddy Garg +4
Modern cloud services are prone to failures due to their complex architecture, making diagnosis a critical process. Site Reliability Engineers (SREs) spend hours leveraging multipl…
Outage-Watch: Early Prediction of Outages using Extreme Event Regularizer
Shubham Agarwal, Sarthak Chakraborty, Shaddy Garg +4
Cloud services are omnipresent and critical cloud service failure is a fact of life. In order to retain customers and prevent revenue loss, it is important to provide high reliabil…