2 citations · 6 across the 14 of their papers we have counts for
16 papers · 1 filter
SWE-Gate: Passing Functional Tests Is Not Enough for Software Engineering Agents
Xin He, Yanlin Wang, Mingwei Liu +3
Repository-level software engineering benchmarks have significantly advanced the evaluation of coding agents, but existing benchmarks primarily measure whether generated patches pa…
From Static to Dynamic: Benchmarking Real-World Code Review with MCR-Bench
Dewu Zheng, Yanlin Wang, Xiwen Wang +5
In real-world software development, code review typically involves iterative interactions between developers and reviewers to improve software quality, making the process costly an…
Advances and Frontiers of LLM-based Issue Resolution in Software Engineering: A Comprehensive Survey
Caihua Li, Lianghong Guo, Yanlin Wang +9
Issue resolution, a complex Software Engineering (SWE) task integral to real-world development, has emerged as a compelling challenge for artificial intelligence. The establishment…
ShortCoder: Knowledge-Augmented Syntax Optimization for Token-Efficient Code Generation
Sicong Liu, Yanxian Huang, Mingwei Liu +6
Code generation tasks aim to automate the conversion of user requirements into executable code, significantly reducing manual development efforts and enhancing software productivit…
SimpleDevQA: Benchmarking Large Language Models on Development Knowledge QA
Jing Zhang, Lianghong Guo, Yanlin Wang +7
The Development Knowledge Question Answering (Dev Knowledge QA) task aims to provide natural language answers to knowledge-seeking questions during software development. To investi…
DaiFu: In-Situ Crash Recovery for Deep Learning Systems
Zilong He, Pengfei Chen, Hongyu Zhang +4
Deep learning (DL) systems have been widely adopted in many areas, and are becoming even more popular with the emergence of large language models. However, due to the complex softw…
OmniGIRL: A Multilingual and Multimodal Benchmark for GitHub Issue Resolution
Lianghong Guo, Wei Tao, Runhan Jiang +7
The GitHub issue resolution task aims to resolve issues reported in repositories automatically. With advances in large language models (LLMs), this task has gained increasing atten…
Towards an Understanding of Context Utilization in Code Intelligence
Yanlin Wang, Kefeng Duan, Dewu Zheng +9
Code intelligence is an emerging domain in software engineering, aiming to improve the effectiveness and efficiency of various code-related tasks. Recent research suggests that inc…
SECRET: Towards Scalable and Efficient Code Retrieval via Segmented Deep Hashing
Wenchao Gu, Ensheng Shi, Yanlin Wang +5
Code retrieval, which retrieves code snippets based on users' natural language descriptions, is widely used by developers and plays a pivotal role in real-world software developmen…
Top General Performance = Top Domain Performance? DomainCodeBench: A Multi-domain Code Generation Benchmark
Dewu Zheng, Yanlin Wang, Ensheng Shi +4
With the rapid advancement of large language models (LLMs), extensive research has been conducted to investigate the code generation capabilities of LLMs. However, existing efforts…
RepoTransBench: A Real-World Multilingual Benchmark for Repository-Level Code Translation
Yanli Wang, Yanlin Wang, Suiquan Wang +8
Repository-level code translation refers to translating an entire code repository from one programming language to another while preserving the functionality of the source reposito…
You Augment Me: Exploring ChatGPT-based Data Augmentation for Semantic Code Search
Yanlin Wang, Lianghong Guo, Ensheng Shi +8
Code search plays a crucial role in software development, enabling developers to retrieve and reuse code using natural language queries. While the performance of code search models…
When to Stop? Towards Efficient Code Generation in LLMs with Excess Token Prevention
Lianghong Guo, Yanlin Wang, Ensheng Shi +6
Code generation aims to automatically generate code snippets that meet given natural language requirements and plays an important role in software development. Although Code LLMs h…
HumanEvo: An Evolution-aware Benchmark for More Realistic Evaluation of Repository-level Code Generation
Dewu Zheng, Yanlin Wang, Ensheng Shi +4
To evaluate the repository-level code generation capabilities of Large Language Models (LLMs) in complex real-world software development scenarios, many evaluation methods have bee…
SparseCoder: Identifier-Aware Sparse Transformer for File-Level Code Summarization
Yanlin Wang, Yanxian Huang, Daya Guo +2
Code summarization aims to generate natural language descriptions of source code, facilitating programmers to understand and maintain it rapidly. While previous code summarization…
KADEL: Knowledge-Aware Denoising Learning for Commit Message Generation
Wei Tao, Yucheng Zhou, Yanlin Wang +3
Commit messages are natural language descriptions of code changes, which are important for software evolution such as code understanding and maintenance. However, previous methods…