activity
20182026
most citedQuantizing Convolutional Neural Networks for Low-Power High-Throughput Inference Engines

20 citations · 27 across the 7 of their papers we have counts for

collaborators
Showing 2025Show all

1 paper · 1 filter

cs.LG2025

KV Pareto: Systems-Level Optimization of KV Cache and Model Compression for Long Context Inference

Sai Gokhale, Devleena Das, Rajeev Patwari +2

Long-context Large Language Models (LLMs) face significant memory bottlenecks during inference due to the linear growth of key-value (KV) cache with sequence length. While individu…