1 citations · 2 across the 7 of their papers we have counts for
4 papers · 1 filter
Argus: Quality-Aware High-Throughput Text-to-Image Inference Serving System
Shubham Agarwal, Subrata Mitra, Saud Iqbal
Text-to-image (T2I) models have gained significant popularity. Most of these are diffusion models with unique computational characteristics, distinct from both traditional small-sc…
RCStat: A Statistical Framework for using Relative Contextualization in Transformers
Debabrata Mahapatra, Shubham Agarwal, Apoorv Saxena +1
Identifying which tokens and activations truly influence model predictions is critical for both the efficiency and interpretability of large auto-regressive language models. Yet in…
Cache-Craft: Managing Chunk-Caches for Efficient Retrieval-Augmented Generation
Shubham Agarwal, Sai Sundaresan, Subrata Mitra +6
Retrieval-Augmented Generation (RAG) is often used with Large Language Models (LLMs) to infuse domain knowledge or user-specific information. In RAG, given a user query, a retrieve…
Prompt-Aware Scheduling for Efficient Text-to-Image Inferencing System
Shubham Agarwal, Saud Iqbal, Subrata Mitra
Traditional ML models utilize controlled approximations during high loads, employing faster, but less accurate models in a process called accuracy scaling. However, this method is…