9 citations · 17 across the 7 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.AI2024★ 2 cited
Benchmarks and Metrics for Evaluations of Code Generation: A Critical Review
Debalina Ghosh Paul, Hong Zhu, Ian Bayley
With the rapid development of Large Language Models (LLMs), a large number of machine learning models have been developed to assist programming tasks including the generation of pr…
cs.SE2024
ScenEval: A Benchmark for Scenario-Based Evaluation of Code Generation
Debalina Ghosh Paul, Hong Zhu, Ian Bayley
In the scenario-based evaluation of machine learning models, a key problem is how to construct test datasets that represent various scenarios. The methodology proposed in this pape…