1 citations · 1 across the 3 of their papers we have counts for
4 papers · 1 filter
Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering
Daniel Rodriguez-Cardenas, Xiaochang Li, Marcos Macedo +5
Large language models for code are advancing fast, yet our ability to evaluate them lags behind. Current benchmarks focus on narrow tasks and single metrics, which hide critical ga…
InterTrans: Leveraging Transitive Intermediate Translations to Enhance LLM-based Code Translation
Marcos Macedo, Yuan Tian, Pengyu Nie +2
Code translation aims to convert a program from one programming language (PL) to another. This long-standing software engineering task is crucial for modernizing legacy systems, en…
An Empirical Study on Developers Shared Conversations with ChatGPT in GitHub Pull Requests and Issues
Huizi Hao, Kazi Amit Hasan, Hong Qin +4
ChatGPT has significantly impacted software development practices, providing substantial assistance to developers in a variety of tasks, including coding, testing, and debugging. D…
Output Format Biases in the Evaluation of Large Language Models for Code Translation
Marcos Macedo, Yuan Tian, Filipe R. Cogo +1
Code translation between programming languages (PLs) is a critical task in software engineering, facilitating the modernization of legacy systems, ensuring cross-platform compatibi…