4 papers · 1 filter
Mitigating Errors in LLM-Generated Web API Invocations via Retrieval-Augmented Generation and Constrained Decoding
Daniel Maninger, Leon Chemnitz, Jannis Brugger +3
Integration of web APIs is a cornerstone of modern software systems, yet writing correct web API invocation code remains challenging due to complex and evolving API specifications.…
Benchmarking Web API Integration Code Generation
Daniel Maninger, Leon Chemnitz, Amir Molzam Sharifloo +2
API integration is a cornerstone of our digital infrastructure, enabling software systems to connect and interact. However, as shown by many studies, writing or generating correct…
Where Do LLMs Still Struggle? An In-Depth Analysis of Code Generation Benchmarks
Amir Molzam Sharifloo, Maedeh Heydari, Parsa Kazerooni +2
Large Language Models (LLMs) have achieved remarkable success in code generation, and the race to improve their performance has become a central focus of AI research. Benchmarks an…
Towards Trustworthy AI Software Development Assistance
Daniel Maninger, Krishna Narasimhan, Mira Mezini
It is expected that in the near future, AI software development assistants will play an important role in the software industry. However, current software development assistants te…