1 citations · 2 across the 2 of their papers we have counts for
3 papers
Cache-Craft: Managing Chunk-Caches for Efficient Retrieval-Augmented Generation
Shubham Agarwal, Sai Sundaresan, Subrata Mitra +6
Retrieval-Augmented Generation (RAG) is often used with Large Language Models (LLMs) to infuse domain knowledge or user-specific information. In RAG, given a user query, a retrieve…
Approximate Caching for Efficiently Serving Diffusion Models
Shubham Agarwal, Subrata Mitra, Sarthak Chakraborty +3
Text-to-image generation using diffusion models has seen explosive popularity owing to their ability in producing high quality images adhering to text prompts. However, production-…
ESRO: Experience Assisted Service Reliability against Outages
Sarthak Chakraborty, Shubham Agarwal, Shaddy Garg +4
Modern cloud services are prone to failures due to their complex architecture, making diagnosis a critical process. Site Reliability Engineers (SREs) spend hours leveraging multipl…