activity
20232026
most citedOutput Format Biases in the Evaluation of Large Language Models for Code Translation

19 citations · 20 across the 5 of their papers we have counts for

collaborators

5 papers

cs.SE2026

Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering

Daniel Rodriguez-Cardenas, Xiaochang Li, Marcos Macedo +5

Large language models for code are advancing fast, yet our ability to evaluate them lags behind. Current benchmarks focus on narrow tasks and single metrics, which hide critical ga…

cs.SE2024★ 1 cited

InterTrans: Leveraging Transitive Intermediate Translations to Enhance LLM-based Code Translation

Marcos Macedo, Yuan Tian, Pengyu Nie +2

Code translation aims to convert a program from one programming language (PL) to another. This long-standing software engineering task is crucial for modernizing legacy systems, en…

cs.SE2024

An Empirical Study on Developers Shared Conversations with ChatGPT in GitHub Pull Requests and Issues

Huizi Hao, Kazi Amit Hasan, Hong Qin +4

ChatGPT has significantly impacted software development practices, providing substantial assistance to developers in a variety of tasks, including coding, testing, and debugging. D…

cs.SE2024★ 19 cited

Output Format Biases in the Evaluation of Large Language Models for Code Translation

Marcos Macedo, Yuan Tian, Filipe R. Cogo +1

Code translation between programming languages (PLs) is a critical task in software engineering, facilitating the modernization of legacy systems, ensuring cross-platform compatibi…

cs.SE2023

Understanding the Time to First Response In GitHub Pull Requests

Kazi Amit Hasan, Marcos Macedo, Yuan Tian +2

The pull-based development is widely adopted in modern open-source software (OSS) projects, where developers propose changes to the codebase by submitting a pull request (PR). Howe…