1 citations · 1 across the 4 of their papers we have counts for
4 papers
MERA Code: A Unified Framework for Evaluating Code Generation Across Tasks
Artem Chervyakov, Alexander Kharitonov, Pavel Zadorozhny +20
Advancements in LLMs have enhanced task automation in software engineering; however, current evaluations primarily focus on natural language tasks, overlooking code quality. Most b…
YABLoCo: Yet Another Benchmark for Long Context Code Generation
Aidar Valeev, Roman Garaev, Vadim Lomshakov +3
Large Language Models demonstrate the ability to solve various programming tasks, including code generation. Typically, the performance of LLMs is measured on benchmarks with small…
Code Summarization Beyond Function Level
Vladimir Makharev, Vladimir Ivanov
Code summarization is a critical task in natural language processing and software engineering, which aims to generate concise descriptions of source code. Recent advancements have…
Leveraging Large Language Models in Code Question Answering: Baselines and Issues
Georgy Andryushchenko, Vladimir Ivanov, Vladimir Makharev +2
Question answering over source code provides software engineers and project managers with helpful information about the implemented features of a software product. This paper prese…