From the 1 of 5 linked papers with an AI index.
5 papers
Beyond Memory Leaderboards: Evaluating Scientific Memory as Budgeted Context Restoration
Maksim Sheverev, David Finkelstein, Sergey Nikolenko
Long-term memory is becoming a core component of LLM agents, but most memory benchmarks evaluate conversations or compact summaries, while research agents need to restore evidence…
AgentLens: Production-Assessed Trajectory Reviews for Coding Agent Evaluation
Andrey Podivilov, Vadim Lomshakov, Sergey Savin +4
AgentLens is an open‑source benchmark that evaluates interactive coding agents by reviewing their entire execution trajectory—how they follow instructions, use tools, verify output…
Query2Diagram: Answering Developer Queries with UML Diagrams
Oleg Baryshnikov, Anton M. Alekseev, Sergey I. Nikolenko
Software documentation frequently becomes outdated or fails to exist entirely, yet developers need focused views of their codebase to understand complex systems. While automated re…
Sparse Prefix Caching for Hybrid and Recurrent LLM Serving
Mikhail Shirokikh, Sergey Nikolenko
Prefix caching is a key latency optimization for autoregressive LLM serving, yet existing systems assume dense per-token key/value reuse. State-space models change the structure of…
LAMeD: LLM-generated Annotations for Memory Leak Detection
Ekaterina Shemetova, Ilya Shenbin, Ivan Smirnov +5
Static analysis tools are widely used to detect software bugs and vulnerabilities but often struggle with scalability and efficiency in complex codebases. Traditional approaches re…