Showing 2026Show all
2 papers · 1 filter
cs.LG2026
RAP: KV-Cache Compression via RoPE-Aligned Pruning
Jihao Xin, Tian Lyu, David Keyes +2
Long-context inference in large language models (LLMs) is bottlenecked by the memory and compute of the key-value (KV) cache. Structured pruning is a direct way to shrink it: dropp…
cs.NI2026
MAESTRO: Multi-Agent Evaluation Suite for Testing, Reliability, and Observability
Tie Ma, Yixi Chen, Vaastav Anand +8
We present MAESTRO, an evaluation suite for the testing, reliability, and observability of LLM-based MAS. MAESTRO standardizes MAS configuration and execution through a unified int…