activity
20202026
most citedOut of the BLEU: how should we assess quality of the Code Generation models?

115 citations · 372 across the 57 of their papers we have counts for

collaborators
Showing 2022Show all

12 papers · 1 filter

cs.SE2022★ 1 cited

So Much in So Little: Creating Lightweight Embeddings of Python Libraries

Yaroslav Golubev, Egor Bogomolov, Egor Bulychev +1

In software engineering, different approaches and machine learning models leverage different types of data: source code, textual information, historical data. An important part of…

cs.SE2022★ 115 cited

Out of the BLEU: how should we assess quality of the Code Generation models?

Mikhail Evtikhiev, Egor Bogomolov, Yaroslav Sokolov +1

In recent years, researchers have created and introduced a significant number of various code generation models. As human evaluation of every new model version is unfeasible, the c…

cs.SE2022

Evaluation of Contrastive Learning with Various Code Representations for Code Clone Detection

Maksim Zubkov, Egor Spirin, Egor Bogomolov +1

Code clones are pairs of code snippets that implement similar functionality. Clone detection is a fundamental branch of automatic source code comprehension, having many application…

cs.SE2022★ 4 cited

Evaluating the Impact of Source Code Parsers on ML4SE Models

Ilya Utkin, Egor Spirin, Egor Bogomolov +1

As researchers and practitioners apply Machine Learning to increasingly more software engineering problems, the approaches they use become more sophisticated. A lot of modern appro…

cs.SE2022★ 3 cited

Assessing Project-Level Fine-Tuning of ML4SE Models

Egor Bogomolov, Sergey Zhuravlev, Egor Spirin +1

Machine Learning for Software Engineering (ML4SE) is an actively growing research area that focuses on methods that help programmers in their work. In order to apply the developed…

cs.SE2022★ 1 cited

All You Need Is Logs: Improving Code Completion by Learning from Anonymous IDE Usage Logs

Vitaliy Bibaev, Alexey Kalina, Vadim Lomshakov +4

In this work, we propose an approach for collecting completion usage logs from the users in an IDE and using them to train a machine learning based model for ranking completion can…