5 citations · 9 across the 8 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.DS2024
Coupling without Communication and Drafter-Invariant Speculative Decoding
Majid Daliri, Christopher Musco, Ananda Theertha Suresh
Suppose Alice has a distribution and Bob has a distribution . Alice wants to draw a sample and Bob a sample such that with as high of probabilit…
cs.LG2024
QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overhead
Amir Zandieh, Majid Daliri, Insu Han
Serving LLMs requires substantial memory due to the storage requirements of Key-Value (KV) embeddings in the KV cache, which grows with sequence length. An effective approach to co…