Showing 2026Show all
2 papers · 1 filter
cs.LG2026
RDKV: Rate-Distortion Bit Allocation for Joint Eviction and Quantization of the KV Cache
Junkai Zhang, Hang Guo, Luca Benini +1
Large language models (LLMs) have shown strong performance across diverse tasks, but their inference with long input contexts is bottlenecked by memory size and bandwidth. The Key-…
cs.DS2026
Bellman-Ford in Almost-Linear Time for Dense Graphs
George Z. Li, Jason Li, Junkai Zhang
We consider the single-source shortest paths problem on a directed graph with real-valued (possibly negative) edge weights and solve this problem in time by refining t…