3 citations · 3 across the 5 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.CL2026
LLM Router: Rethinking Routing with Prefill Activations
Tanay Varshney, Annie Surla, Michelle Xu +5
Existing routers rely on semantic query features or handcrafted features, which often fail to capture model-specific failures or intrinsic task difficulty. We instead route using i…
cs.LG2026
KVzap: Fast, Adaptive, and Faithful KV Cache Pruning
Simon Jegou, Maximilian Jeblick
Growing context lengths in transformer-based language models have made the key-value (KV) cache a critical inference bottleneck. While many KV cache pruning methods have been propo…