activity
20192026
most citedCan LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLs

87 citations · 209 across the 38 of their papers we have counts for

collaborators
Showing 2024Show all

10 papers · 1 filter

cs.SE2024★ 2 cited

ExploraCoder: Advancing code generation for multiple unseen APIs via planning and chained exploration

Yunkun Wang, Yue Zhang, Zhen Qin +5

Large language models face intrinsic limitations in coding with APIs that are unseen in their training corpora. As libraries continuously evolve, it becomes impractical to exhausti…

cs.SE2024

LLMs as Continuous Learners: Improving the Reproduction of Defective Code in Software Issues

Yalan Lin, Yingwei Ma, Rongyu Cao +4

Reproducing buggy code is the first and crucially important step in issue resolving, as it aids in identifying the underlying problems and validating that generated patches resolve…

cs.SE2024★ 2 cited

Lingma SWE-GPT: An Open Development-Process-Centric Language Model for Automated Software Improvement

Yingwei Ma, Rongyu Cao, Yongchang Cao +7

Recent advancements in LLM-based agents have led to significant progress in automatic software engineering, particularly in software maintenance and evolution. Despite these encour…

cs.CL2024

In-Context Transfer Learning: Demonstration Synthesis by Transferring Similar Tasks

Dingzirui Wang, Xuanliang Zhang, Qiguang Chen +9

In-context learning (ICL) is an effective approach to help large language models (LLMs) adapt to various tasks by providing demonstrations of the target task. Considering the high…

cs.CL2024★ 2 cited

EvoCodeBench: An Evolving Code Generation Benchmark with Domain-Specific Evaluations

Jia Li, Ge Li, Xuanming Zhang +6

How to evaluate Large Language Models (LLMs) in code generation remains an open question. Existing benchmarks have two limitations - data leakage and lack of domain-specific evalua…

cs.SE2024★ 2 cited

Codev-Bench: How Do LLMs Understand Developer-Centric Code Completion?

Zhenyu Pan, Rongyu Cao, Yongchang Cao +5

Code completion, a key downstream task in code generation, is one of the most frequent and impactful methods for enhancing developer productivity in software development. As intell…

cs.LG2024

Scaling Offline Model-Based RL via Jointly-Optimized World-Action Model Pretraining

Jie Cheng, Ruixi Qiao, Yingwei Ma +5

A significant aspiration of offline reinforcement learning (RL) is to develop a generalist agent with high capabilities from large and heterogeneous datasets. However, prior approa…

cs.SE2024★ 7 cited

Alibaba LingmaAgent: Improving Automated Issue Resolution via Comprehensive Repository Exploration

Yingwei Ma, Qingping Yang, Rongyu Cao +3

This paper presents Alibaba LingmaAgent, a novel Automated Software Engineering method designed to comprehensively understand and utilize whole software repositories for issue reso…

cs.CL2024

DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories

Jia Li, Ge Li, Yunfei Zhao +15

How to evaluate the coding abilities of Large Language Models (LLMs) remains an open question. We find that existing benchmarks are poorly aligned with real-world code repositories…

cs.CL2024

Unifying Structured Data as Graph for Data-to-Text Pre-Training

Shujie Li, Liang Li, Ruiying Geng +8

Data-to-text (D2T) generation aims to transform structured data into natural language text. Data-to-text pre-training has proved to be powerful in enhancing D2T generation and yiel…