200 citations · 634 across the 27 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023★ 3 cited
StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of Code
Hannah McLean Babe, Sydney Nguyen, Yangtian Zi +3
Code LLMs are being rapidly deployed and there is evidence that they can make professional programmers more productive. Current benchmarks for code generation measure whether model…
cs.LG2022★ 14 cited
MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation
Federico Cassano, John Gouwar, Daniel Nguyen +10
Large language models have demonstrated the ability to generate both natural language and programming language text. Such models open up the possibility of multi-language code gene…