most citedOutput Format Biases in the Evaluation of Large Language Models for Code Translation

19 citations · 35 across the 10 of their papers we have counts for

collaborators
Showing cs.SEShow all

7 papers · 1 filter

cs.SE2026

How Developers Adopt, Use, and Evolve CI/CD Caching: An Empirical Study on GitHub Actions

Kazi Amit Hasan, Yuan Tian, Safwat Hassan +1

Continuous Integration/Continuous Delivery (CI/CD) caching is widely used to reduce repeated computation and improve CI/CD efficiency, yet maintaining effective caching requires on…

cs.SE2026

When LLMs Lag Behind: Knowledge Conflicts from Evolving APIs in Code Generation

Ahmed Nusayer Ashik, Shaowei Wang, Tse-Hsun Chen +2

The rapid evolution of software libraries creates a significant challenge for Large Language Models (LLMs), whose static parametric knowledge often becomes stale post-training. Whi…

cs.SE2026

From Docs to Descriptions: Smell-Aware Evaluation of MCP Server Descriptions

Peiran Wang, Ying Li, Yuqiang Sun +3

The Model Context Protocol (MCP) has rapidly become a de facto standard for connecting LLM-based agents with external tools via reusable MCP servers. In practice, however, server s…

cs.SE2026

Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering

Daniel Rodriguez-Cardenas, Xiaochang Li, Marcos Macedo +5

Large language models for code are advancing fast, yet our ability to evaluate them lags behind. Current benchmarks focus on narrow tasks and single metrics, which hide critical ga…

cs.SE2024★ 1 cited

InterTrans: Leveraging Transitive Intermediate Translations to Enhance LLM-based Code Translation

Marcos Macedo, Yuan Tian, Pengyu Nie +2

Code translation aims to convert a program from one programming language (PL) to another. This long-standing software engineering task is crucial for modernizing legacy systems, en…

cs.SE2024★ 14 cited

An Empirical Study of Developers' Challenges in Implementing Workflows as Code: A Case Study on Apache Airflow

Jerin Yasmin, Jiale Wang, Yuan Tian +1

The Workflows as Code paradigm is becoming increasingly essential to streamline the design and management of complex processes within data-intensive software systems. These systems…

cs.SE2024★ 19 cited

Output Format Biases in the Evaluation of Large Language Models for Code Translation

Marcos Macedo, Yuan Tian, Filipe R. Cogo +1

Code translation between programming languages (PLs) is a critical task in software engineering, facilitating the modernization of legacy systems, ensuring cross-platform compatibi…