3 papers
cs.SE2025
DSCodeBench: A Realistic Benchmark for Data Science Code Generation
Shuyin Ouyang, Dong Huang, Jingwen Guo +3
We introduce DSCodeBench, a new benchmark designed to evaluate large language models (LLMs) on complicated and realistic data science code generation tasks. DSCodeBench consists of…
cs.CL2025
SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers
Yanzheng Xiang, Hanqi Yan, Shuyin Ouyang +2
This study evaluates large language models (LLMs) in generating code from algorithm descriptions in recent NLP papers. The task requires two key competencies: (1) algorithm compreh…
cs.SE2025
Knowledge-Enhanced Program Repair for Data Science Code
Shuyin Ouyang, Jie M. Zhang, Zeyu Sun +1
This paper introduces DSrepair, a knowledge-enhanced program repair method designed to repair the buggy code generated by LLMs in the data science domain. DSrepair uses knowledge g…