most citedEvaluating Language Models for Efficient Code Generation

2 citations · 2 across the 3 of their papers we have counts for

collaborators
Showing cs.SEShow all

2 papers · 1 filter

cs.SE2024★ 2 cited

Evaluating Language Models for Efficient Code Generation

Jiawei Liu, Songrun Xie, Junhao Wang +3

We introduce Differential Performance Evaluation (DPE), a framework designed to reliably evaluate Large Language Models (LLMs) for efficient code generation. Traditional coding ben…

cs.SE2024

RepoQA: Evaluating Long Context Code Understanding

Jiawei Liu, Jia Le Tian, Vijay Daita +5

Recent advances have been improving the context windows of Large Language Models (LLMs). To quantify the real long-context capabilities of LLMs, evaluators such as the popular Need…