2 papers
cs.LG2025
SWE-Bench-CL: Continual Learning for Coding Agents
Thomas Joshi, Shayan Chowdhury, Fatih Uysal
Large Language Models (LLMs) have achieved impressive results on static code-generation benchmarks, but real-world software development unfolds as a continuous stream of evolving i…
cs.LG2025
Paged Attention Meets FlexAttention: Unlocking Long-Context Efficiency in Deployed Inference
Thomas Joshi, Herman Saini, Neil Dhillon +2
Large Language Models (LLMs) encounter severe memory inefficiencies during long-context inference due to conventional handling of key-value (KV) caches. In this work, we introduce…