6 citations · 11 across the 27 of their papers we have counts for
6 papers · 1 filter
KV-CAR: KV Cache Compression using Autoencoders and KV Reuse in Large Language Models
Sourjya Roy, Shrihari Sridharan, Surya Selvam +1
As Large Language Models (LLMs) scale in size and context length, the memory requirements of the key value (KV) cache have emerged as a major bottleneck during autoregressive decod…
GradientSpace: Unsupervised Data Clustering for Improved Instruction Tuning
Shrihari Sridharan, Deepak Ravikumar, Anand Raghunathan +1
Instruction tuning is one of the key steps required for adapting large language models (LLMs) to a broad spectrum of downstream applications. However, this procedure is difficult b…
Experts are all you need: A Composable Framework for Large Language Model Inference
Shrihari Sridharan, Sourjya Roy, Anand Raghunathan +1
Large Language Models (LLMs) have achieved state-of-the-art accuracies in a variety of natural language processing (NLP) tasks. However, this success comes at the cost of increased…
Ev-Edge: Efficient Execution of Event-based Vision Algorithms on Commodity Edge Platforms
Shrihari Sridharan, Surya Selvam, Kaushik Roy +1
Event cameras have emerged as a promising sensing modality for autonomous navigation systems, owing to their high temporal resolution, high dynamic range and negligible motion blur…
X-Former: In-Memory Acceleration of Transformers
Shrihari Sridharan, Jacob R. Stevens, Kaushik Roy +1
Transformers have achieved great success in a wide variety of natural language processing (NLP) tasks due to the attention mechanism, which assigns an importance score for every wo…
TxSim:Modeling Training of Deep Neural Networks on Resistive Crossbar Systems
Sourjya Roy, Shrihari Sridharan, Shubham Jain +1
Resistive crossbars have attracted significant interest in the design of Deep Neural Network (DNN) accelerators due to their ability to natively execute massively parallel vector-m…