6 citations · 6 across the 7 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.AI2026
GAAC: Lossless KV Compression for Bandwidth-Efficient LLM Inference on Personal Devices
Yipin Guo, Arun M George, Siddharth Joshi
Weight-only, lossy quantization substantially reduces the storage and memory requirements for serving large language models (LLMs), but the growing key-value (KV) cache remains a b…
cs.LG2026
QTEA: Ternary LLMs with Sparse Residual Salient Weight and By-Column Optimization
Yipin Guo, Arun M George, Jie Fu +3
Weight-only post-training quantization (PTQ) can alleviate the computational burden of serving large language models (LLMs) at scale. However, existing PTQ methods often fail to ge…
cs.DC2026
SplitZip: Ultra Fast Lossless KV Compression for Disaggregated LLM Serving
Yipin Guo, Siddharth Joshi
Contemporary systems serving large language models (LLMs) have adopted prefill-decode disaggregation to load-balance between the compute-bound prefill phase and the memory-bound de…