7 papers
Transforming Privacy Artifacts into Accessible Reports for Non-Technical Stakeholders
Zoe Pfister, Clemens Sauerwein, Benedikt Dornauer +4
The transition toward Industry 5.0 is reshaping industrial work environments with an emphasis on human-centricity, enabling close collaboration between humans and machines to enhan…
RESTestBench: A Benchmark for Evaluating the Effectiveness of LLM-Generated REST API Test Cases from NL Requirements
Leon Kogler, Stefan Hangler, Maximilian Ehrhart +3
Existing REST API testing tools are typically evaluated using code coverage and crash-based fault metrics. However, recent LLM-based approaches increasingly generate tests from NL…
RAGnaroX: A Secure, Local-Hosted ChatOps Assistant Using Small Language Models
Benedikt Dornauer, Mircea-Cristian Racasan
This paper introduces RAGnaroX, a resource-efficient ChatOps assistant that operates entirely on commodity hardware. Unlike existing solutions that often rely on external providers…
RAG-DIVE: A Dynamic Approach for Multi-Turn Dialogue Evaluation in Retrieval-Augmented Generation
Lorenz Brehme, Benedikt Dornauer, Jan-Henrik Böttcher +3
Evaluating Retrieval-Augmented Generation (RAG) systems using static multi-turn datasets fails to capture the dynamic nature of real-world dialogues. Existing evaluation methods re…
RESTifAI: LLM-Based Workflow for Reusable REST API Testing
Leon Kogler, Maximilian Ehrhart, Benedikt Dornauer +1
With this paper, we introduce RESTifAI, an LLM-driven approach for generating reusable, CI/CD ready REST API tests, following the happy-path approach. Unlike existing tools that of…
The Future of Generative AI in Software Engineering: A Vision from Industry and Academia in the European GENIUS Project
Robin Gröpler, Steffen Klepke, Jack Johns +12
Generative AI (GenAI) has recently emerged as a groundbreaking force in Software Engineering, capable of generating code, identifying bugs, recommending fixes, and supporting quali…