2 papers
cs.LG2025
STRIDE: Structure and Embedding Distillation with Attention for Graph Neural Networks
Anshul Ahluwalia, Payman Behnam, Rohit Das +4
Recent advancements in Graph Neural Networks (GNNs) have led to increased model sizes to enhance their capacity and accuracy. Such large models incur high memory usage, latency, an…
cs.CL2025
RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression
Payman Behnam, Yaosheng Fu, Ritchie Zhao +3
Transformer-based Large Language Models rely critically on the KV cache to efficiently handle extended contexts during the decode phase. Yet, the size of the KV cache grows proport…