From the 1 of 3 linked papers with an AI index.
3 papers
cs.AI2026
AgentLens: Production-Assessed Trajectory Reviews for Coding Agent Evaluation
Andrey Podivilov, Vadim Lomshakov, Sergey Savin +4
AgentLens is an open‑source benchmark that evaluates interactive coding agents by reviewing their entire execution trajectory—how they follow instructions, use tools, verify output…
cs.CL2025
YABLoCo: Yet Another Benchmark for Long Context Code Generation
Aidar Valeev, Roman Garaev, Vadim Lomshakov +3
Large Language Models demonstrate the ability to solve various programming tasks, including code generation. Typically, the performance of LLMs is measured on benchmarks with small…
cs.SE2025
LAMeD: LLM-generated Annotations for Memory Leak Detection
Ekaterina Shemetova, Ilya Shenbin, Ivan Smirnov +5
Static analysis tools are widely used to detect software bugs and vulnerabilities but often struggle with scalability and efficiency in complex codebases. Traditional approaches re…