5 papers
Mitigating Errors in LLM-Generated Web API Invocations via Retrieval-Augmented Generation and Constrained Decoding
Daniel Maninger, Leon Chemnitz, Jannis Brugger +3
Integration of web APIs is a cornerstone of modern software systems, yet writing correct web API invocation code remains challenging due to complex and evolving API specifications.…
Beyond BLEU: A Semantic Evaluation Method for Code Translation
Julius Näumann, Sven Keidel, Amir Molzam Sharifloo +1
Code translation is one of the core capabilities of LLMs. However, evaluating the correctness of translations remains difficult, as commonly used metrics such as BLEU measure only…
Deep Graph-Language Fusion for Structure-Aware Code Generation
Mert Tiftikci, Amir Molzam Sharifloo, Mira Mezini
Pre-trained Language Models (PLMs) have the potential to transform software development tasks. However, despite significant advances, current PLMs struggle to capture the structure…
Where Do LLMs Still Struggle? An In-Depth Analysis of Code Generation Benchmarks
Amir Molzam Sharifloo, Maedeh Heydari, Parsa Kazerooni +2
Large Language Models (LLMs) have achieved remarkable success in code generation, and the race to improve their performance has become a central focus of AI research. Benchmarks an…
Benchmarking Web API Integration Code Generation
Daniel Maninger, Leon Chemnitz, Amir Molzam Sharifloo +2
API integration is a cornerstone of our digital infrastructure, enabling software systems to connect and interact. However, as shown by many studies, writing or generating correct…